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' We consider a processor sharing queue where the number of jobs 

QQ , served at any time is limited to K, with the excess jobs waiting 

in a buffer. We use random counting measures on the positive axis 

' J ' , to model this system. The limit of this measure- valued process is 

Mm . obtained under diffusion scaling and heavy traffic conditions. As a 

Qh ' consequence, the limit of the system size process is proved to be a 

, piece-wise reflected Brownian motion. 
> . 

^ I 1. Introduction. This paper is concerned with developing a diffusion ap- 
proximation for a limited processor sharing (LPS) queue, which consists of 

^SJ . a single server and an infinite capacity buffer. In such a system, the server 

^ I can serve up to -RT > 1 jobs simultaneously, equally distributing its attention 
to each of them. In other words, each job in the server is processed at a 

^) . rate that is the reciprocal of the number of jobs in the server. An arriving 

I job will immediately enter the server and start receiving service if there are 

■ less than K jobs in the server when it arrives; otherwise it will wait in the 
, buffer. A job will leave the system immediately after the server has fulfilled 
I its service requirement. When the number of jobs in the server drops from 

^ ' K to K — 1, the server will immediately admit the longest waiting customer 

• ^ , from the buffer, if there is one. We assume that jobs arrive according to a 

^ I general arrival process, and the job sizes are independent of each other and 

■ identically distributed. 
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Note that letting K = oo makes the system a standard processor sharing 
(PS) queue, which has been the focal point of significant recent research 
activity. The PS discipline can be viewed as an idealization of time-sharing 
protocols in computer systems, as described in [20] and [23]. The advantage 
is that a big job will not block the whole system as in a first-come-first-serve 
(FCFS) queue. However, allowing too many jobs to time-share at once can 
lead to significant overhead due to switching, and hence reduce overall per- 
formance. This point has already been observed in early studies of operating 
systems [5, 8], as well as in more recent Web server design papers [10, 18] 
and database implementation papers [16, 24]. So in the modeling of many 
computer and communication systems, a sharing limit is normally imposed, 
which results in the LPS model. 

Despite the numerous applications, there are only a few studies on the 
LPS queue. Avi-Itzhak and Halfin [2] propose an approximation for the mean 
response time assuming Poisson arrivals. A computational analysis based 
on matrix geometric methods is performed in Zhang and Lipsky [27, 28]. 
Some stochastic ordering results are derived in Nuyens and van de Weij [21]. 
Recently, Zhang, Dai and Zwart [29] have developed a fluid approximation 
for the LPS queue using the framework of measure-valued processes. As a 
continuation of [29] , the present study investigates a diffusion approximation 
for the LPS queue in the heavy traffic regime. 

In our model, the system consists of a server for serving jobs and a 
buffer for holding the waiting jobs. We model the LPS queue by means of 
a measure-valued process {Q{-),Z{-)). Each component of the process takes 
values in the space of finite, nonnegative Borel measures on M_|_ = [0,oo). 
For each t>0, Z{t) puts unit mass at the residual job size of each job in the 
server at time t > 0, and Q{t) puts unit mass at the job size of each job in 
the buffer at time i > 0. The main insight of our approach is to design the 
stochastic dynamic equations (2.5) and (2.6) using the measure valued pro- 
cess (Q(-), -Z(-)), which can describe the evolution of the system. Our asymp- 
totic regime is when the sharing limit K is large and the queue is critically 
loaded. Following the standard practice in the literature, we consider a se- 
quence of queues indexed by r £ M+. We assume that lim,._j.oo K''' /r = > 
and the traffic intensity goes to the critical value 1 as in (2.23), where K^' is 
the sharing limit in the rth queue. (Superscript r indicates a quantity that 
is associated with the rth queue.) 

We are interested in the limit of the diffusion scaled process 



as r goes to infinity. As shown in Williams [26], a key step to obtain a 
diffusion limit in heavy traffic is to establish a state-space collapse (SSC) re- 
sult. In our setting, the SSC means that the diffusion-scaled measure-valued 
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process, which is an infinite-dimensional object, is close to a determinis- 
tic function of the diffusion-scaled, one-dimensional workload process. (See 
Definition 2.1 for the lifting map to define the function.) The workload pro- 
cess is invariant under any nonidling service policy, and its diffusion limit 
is a one-dimensional reflected Brownian motion (RBM). The main result 
of this paper (Theorem 2.1) is that our measure- valued diffusion limit is 
a deterministic function of the one-dimensional RBM. As a corollary, the 
diffusion-scaled system size process converges in distribution to a piecewise 
linear RBM. 

Most of this paper is devoted to proving the SSC result for each fixed 
time T > (Theorem 2.2). Our proof strategy is analogous to the modular 
approach proposed in Bramson [6] and Williams [26]. For our sequence of 
systems, we define a critically loaded measure- valued fluid model. The fluid 
model in this paper is the same LPS fluid model developed in [29], specialized 
for the critically loaded case. We show that our fluid model exhibits an SSC: 
each fluid model solution converges to an equilibrium state in some uniform 
sense, and each equilibrium state has an SSC. 

We adopt Bramson's framework in [6] to translate the fluid model SSC 
result into the diffusion-scaled SSC result. The diffusion scaled process on the 
interval [0, T] corresponds to unsealed process on the interval [0, r^T] . Fix a 
constant L > 1, the interval [0,r^T] is covered by the [rTj -|- 1 overlapping 
intervals 

[rm,rm + rL], m = 0,1, \rT\. 

On each of these intervals, the diffusion scaled process can be viewed as a 
shifted, fluid-scaled process defined by 

(-Q''{rm + rt),-Z''{rm + rt)], 0<t<L. 
\r r ) 

To carry out the translation, we need to show that (a) each limit from 
the family of shifted, fiuid-scaled processes is a solution to the fiuid model 
(such a limit is called a fiuid limit in this paper, also known as a "cluster 
point" in [6]); (b) the set of fluid limits is "rich": with large probability, 
each shifted, fluid-scaled measure- valued process is close to some fluid limit. 
A major step to proving (a) and (b) is to show, with large probability, the 
precompactness of the shifted fluid scaled processes (see Theorem 4.1 for 
details). Since m ranges from to [rTj , this involves a substantial reflnement 
of the arguments in [29], where the case m = is treated. 

Establishing SSC for the fluid model requires a study of equilibrium states 
for the LPS fluid model developed in [29]. In Section 3, we characterize the 
set of equilibrium states, and show that each fluid model solution with initial 
condition belonging to a compact set converges uniformly to its equilibrium 
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state. The counterpart of this study for standard PS queues has been carried 
out in [22]. Standard PS queues are relatively tractable since their fluid 
models can be related (by means of a time-change) to a renewal equation. 
This is not the case for LPS systems (as explained in [29]), so a different 
approach is necessary. The idea behind the proof of the uniform convergence 
is to carefully track the total mass of the fluid model, and determine whether 
it is eventually bigger, smaller or equal to the sharing limit K. Several 
insights (explained in Sections 3.2 and 3.3) lead us to apply a uniform version 
of the renewal theorem which is new to the best of our knowledge. This 
version is given in Appendix B.l. 

The framework of measure- valued process has been successfully applied to 
study models where multiple jobs are processed at the same time. The main 
idea is to use a sufficiently detailed state descriptor to adequately describe 
the system. A sequence of papers, Gromoll, Puha and Williams [14], Puha 
and Williams [22] and Gromoll [12], has successfully established the fluid 
and diffusion approximations for PS queues using measure- valued processes. 
More recently, the framework of measure-valued process has been further 
developed by Gromoll and Kruk [13] and Gromoll, Robert and Zwart [15] 
in the study of queues with deadlines/impatience. Doytchinov, Lehoczky 
and Shreve [9] applied a similar framework to study the earliest deadline 
first discipline. This framework is also applied by Kaspi and Ramanan [19] 
on many-server queues. The results in the present paper can be seen as an 
extension of the results in the papers [12, 22], which carry out a similar 
program for the standard PS queue. 

This paper is organized as follows. A model description and an overview of 
the main results is given in Section 2. Section 3 investigates the convergence 
of each fluid model solution to its equilibrium state. Precompactness of the 
family of shifted fluid scaled processes is established in Section 4. Section 
5 uses the precompactness to show the "richness" of the fluid limits, and 
then concludes with a proof of state-space collapse. Several additional useful 
results, such as a uniform version of the renewal theorem, and a useful bound 
for the Prohorov metric are developed in Appendices B and C. 

1.1. Notation. The following notation will be used throughout. Let N, 
Z and M denote the set of natural numbers, integers and real numbers, 
respectively. Let M+ = [0,oo). For a, 6 G M, write a"*" for the positive part of 
a, [aj for the integer part, [a] for [aj -|- 1, a V 6 for the maximum and a A 6 
for the minimum. 

Let M denote the set of all nonnegative finite Borel measures on [0,00). 
To simplify the notation, let us take the convention that for any Borel set 
A C R, v{A n (-cx),0)) = for any 1/ G M. For iyi,V2 £ M, the Prohorov 
metric is defined to be 

d[j^i,z>2] = inf{e >Q:ui{A) < U2{A'^) +e and 
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U2{A) < ui{A^) + e for all Borel set vl C M}, 

where = {b & M:infagyi|a — b\ < e}. This same metric was defined and 
used in Gromoll and Kruk [13]; they showed that the space M is com- 
plete and separable under the metric. For any Borel measurable function 
g':M+ — )• M, the integration of this function with respect to the measure 
u G M, J^^ g{x)iy{dx), is denoted by {g,i^). 

Let M X M denote the Cartesian product. There are a number of ways 
to define the metric on the product space. For convenience, we define the 
metric to be the maximum of the Prohorov metric between each component. 
With a little abuse of notation, we still use d to denote this metric. 

Let (E, tt) be a general metric space. We consider the space D of all 
right-continuous E-valued functions with finite left limits defined either on 
a finite interval [0,T] or the infinite interval [0,oo). We refer to the space as 
D([0, r],E) or D([0, oo), E) depending on the function domain. The space D 
is also known as the space of cadlag functions. For g{-),g'{-) G D([0,T],E), 
the uniform metric is defined as 

(1.1) VT[g,g']= sup 7r[g{t),g'{t)]. 

0<t<T 

However, a more useful metric we will use is the following Skorohod Ji 
metric: 

(1-2) gT[g,g']= ini {\\mvvT[g,g'of]), 

feAr 

where go /(•) = g{f{-)) for t>0 and At is the set of strictly increasing and 
continuous mapping of [0, T] onto itself and 



T = sup 

0<s<t<T 



t- 



If g{-) and g'{-) are in the space D([0,oo),E), the Skorohod Ji metric is 
defined as 

/•oo 

(1.3) Q[g,g']= e-^iQT[g,g']/\i)dT. 

Jo 

By "convergence in the space D," we mean the convergence under the Sko- 
rohod Ji topology, which is induced by the Skorohod Ji metric [11]. 

We use "— )•" to denote the convergence in the metric space (E,7r), and 
"=>" to denote the convergence in distribution of random variables taking 
values in the metric space (E,7r). 

2. Models and main results. In this section, we first introduce the math- 
ematical model. We then present the main results of this paper. Following 
this, is an outline of our proof. 
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2.1. The limited processor sharing queue. We consider a G/GI/1 queue 
operated under the limited processor sharing pohcy, with the sharing hmit 
equal to K. We use Q{t), Z(t) and X(t) to denote the number of jobs in 
the buffer, the number of jobs in service, and the total number of jobs in 
the system at time t, respectively. Thus, 

(2.1) X{t) = Q{t) + Z{t) fort>0. 

We adopt the convention that Q(-), Z{-) and X{-) are right continuous. The 
system is allowed to be nonempty initially, that is, X(0) > 0. We index jobs 
by i = -X{0) + 1, -X{0) + 2, . . . , 0, 1, . . . . The first X{0) jobs are initially 
in the system, with jobs i = —X{0) + 1, . . . , —(5(0) in service and jobs i = 
—(5(0) + 1, . . . , waiting in the buffer. Jobs arrived after time are indexed 
by « = 1, 2, . . . , according to the order of arrival. When a batch arrival occurs, 
an arbitrary rule is used to break the tie for the arrivals in the batch. The 
service policy in this model is FCFS. Let E{t) denote the number of jobs that 
arrive at the buffer during time interval (0, t], for all t>0. Our arrival process 
{E{t),t > 0} is assumed to be general, as long as it satisfies a functional 
central limit theorem [see (2.14)]. According to the policy, a job may have 
to wait for a certain amount of time after arrival to get service. Let Wi 
denote the waiting time, and Ui denote the arrival time of the ith job for all 
i > —X{0). By convention, Ui = for i < 0, and Wi = for i < —(5(0). Let 

Ti = Ui + Wi, i>-X{0). 

The quantity Tj can be viewed as the time that the ith job starts service. 
We use Vi to denote the job size of the ith job for all i > —(5(0). We assume 
that {vi}^_^ is a sequence of i.i.d. random variables with distribution F{-). 
Denote v the probability measure associated with the distribution function 
F(-). For jobs with index -X{0) < i < -(5(0), that is, the first Z{0) jobs that 
are initially in service, we use Vi to denote the remaining job size of the job. 
The sequence {vi}'^^_^ is allowed to be general. We call {E{-),{vi}'^^} the 
stochastic primitives of the system, and {Z{0),Q{0),{vi}^^_^,{vi}^^_^} 
the initial conditions of the system. 

Now we introduce a measure-valued state descriptor (Q(-),Z(-)) e M x 
M, which describes the evolution of the system with given initial conditions 
and stochastic primitives. For any Borel set A C [0,oo), Q{t){A) denotes the 
total number of jobs in the buffer whose job size belongs to A; and for any 
Borel set A C (0,oo), Z{t){A) denotes the total number of jobs in service 
whose residual job size belongs to A. Since no job can be in service with 
residual job size 0, Z[t){{0}) = for all t>0. It is clear that we have the 
following relationship: 



Q{t) = {l,Q{t)), Z{t) = {l,Z{t)). 
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Define the cumulative service amount up to time t by 
(2.2) S{t)= f\{Z{T))dT, 



where 'ip{x) = l/x if x > and ip{x) = if x = 0. A job will have received a 
cumulative amount of processing time 

S{s,t)= l\{Z{T))dT 
J s 

during time interval \s,t\ if it is in service in this time period. Let 

(2.3) B{t) = E{t)-Q{t). 

Note that at time t > 0, B{t) is the index of the last job which has entered 
into service by time t. Thus, 

(2.4) B{s,t) = B{t)-B{s) 

represents the number of jobs which have left the buffer and entered the 
server during time interval (s,t]. Using the notation introduced in this sec- 
tion, the state descriptor can be written as 

E(t) 

(2.5) Q{t){A)= ^-M), Ac[0,oo), 

i=B{t)+l 



(2.6) 



-Q{0) 

Z{t){A)= Yl ^niA + S{t)) 

i=-X{0)+l 



B{t) 

+ Y K{A + S{Ti,t)), ^C(0,oo), 
i=-Q(0)+l 

with 2(t)({0}) = 0, where 5a{A) denotes the Dirac measure of point a on 
M and A + y = {a + y:a^ A}. Due to the LPS policy, the sharing limit K 
must be enforced at any time t, 

(2.7) Q{t) = {X{t)-K)+, 

(2.8) Z{t) = {X{t) hK). 

We call (2.5) and (2.6) the stochastic dynamic equations and (2.7) and (2.8) 
the policy constraints. 

For t > 0, the workload of the system W{t) is defined to be the amount 
of time that the server remains busy if no more arrivals are allowed into 
the system at time t. Using the state descriptor (Q,2^), we can recover the 
workload W{t) at time t > by 

(2.9) W(t) = {x,Q{t)+Z{t)), 
where x denotes the identity function on M. 
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2.2. Main results. Consider a sequence of limited processor sharing queues 
indexed by r, where r increases to oo through a sequence in (0,oo). Each 
queue is defined in the same way as in Section 2.1. To distinguish mod- 
els with different indices, quantities of the rth model are accompanied by 
superscript r. Each model may be defined on a different probability space 
(fi'', J^^,P^). Our results concern the asymptotic behavior of the descriptor 
under the diffusion scaling, which is defined by 

(2.10) Q-[t) = ^Q'{rH), Z^{t) = ^Z'\rh), 

for all t > 0. We are also interested in other diffusion scaled quantities like 
the workload and queue length processes. Note that Q^{-), and VK^(-) 

are actually functions of {Q^ {■) , {■)) , so the scaling for these quantities is 
defined as the functions of the corresponding scaling for {Q^ {•) , Z^ {•)) , that 



is, 

(2.11) Q-(t) = (l,Q-(t))=iQ-(r2t), 

r 

(2.12) Z'it) = {l,Z'{t)) = ^Z'{rh), 

(2.13) W'it) = ix, Q'it) + i'-(t)) = -W^irh), 



for all t > 0. 

To establish results on the convergence of the above sequence of stochastic 
processes, we need the following conditions, which are quite general and 
standard. We assume that the arrival processes satisfy 

(2.14) ^ — ^E*{-) asr^oo, 

r 

for some sequence {A''} that satisfies 

(2.15) limA'' = A>0, 

r— >oo 

and E*{-) is a Brownian motion with drift and variance Ac^. And the 
probability measure of job sizes in the rth system satisfies that as r — )• oo 

(2.16) d[z^^i/]^0, 

(2.17) lim sup / x'^^'^^ v^' {dx) ^ for some p > 0, 

N^oo r J[N,oo) 

where the probability measure satisfies 

(2.18) I' has no atoms. 

Assumption (2.17) is stronger than the "two-plus-epsilon moment" assump- 
tion needed for a functional central limit theorem. The stronger assumption 
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is used in a separate part of our analysis to estimate moments of the shifted 
fluid scaled state descriptors (see Lemma D.l, and its application in Lemma 
4.3). The extra moment assumption also appears in [12, 13]. Since the space 
is scaled by r in the diffusion scaling, the sharing limit should be scaled 
accordingly: 

(2.19) lim K'' /r K > 0. 

r— >-oo 

Also, the following initial condition will be assumed: 

(2.20) (Q^(0),i^(0))^(r,;u*), 

(2.21) ix'^P, Q^iO) + i^(0)) (x^+^ r + /i*), 

as r — )• oo, where p is the same as in (2.17), (C*,/^*) G M x M and 

(2.22) fi* has no atoms. 

Define the traffic intensity of the rth stochastic system by p'^ = X'{x,i''^)- 
We need the following heavy traffic condition: 

(2.23) lim r(l - p') = 9 > 0. 

Let /3 = {x, I') be the mean and = ^'^ '^^^ ^ be the squared coefficient 
of variation (SCV) of the job size distribution v. The following proposition 
is a well-known heavy traffic approximation for the workload process of a 
single queue operated under a nonidling policy. Readers are referred to [12] 
for a proof. 

Proposition 2.1. Assume (2.14)-(2.17), (2.20), (2.21) and (2.23). 
The sequence of diffusion scaled workload process 

W'-{.)^W*{-) asr^oo, 

where W*{-) is a reflected Brownian motion with drift —9, variance P{c'^ + 
c^) and initial value w* = {x,C* + A**)- 

Since the LPS is also a nonidling service policy, the above result on the 
workload process is still true for our model. However, it remains an open 
question about the job size process X{-) and many other performance pro- 
cesses as introduced in Section 2.1. Our main result establishes the diffusion 
limit for the measure- valued processes (Theorem 2.1), from which the diffu- 
sion limit of queue length process follows directly (Corollary 2.1). 

Denote 

where Ue is the equilibrium measure of u, that is, fe([0, x]) = ^ iy{{y, oo)) dy 
for all a; > 0. We have the following definition. 



10 



J. ZHANG, J. G. DAI AND B. ZWART 



Definition 2.1. Let Ak,u-^+ — ^ M x M be the lifting map associated 
with the probabihty measure and constant K given by 

Ak,uW={ ^ 1", ^ I'eJ foru;GM+. 

Note that Ak y maps the workload, which is in M_|_, to a measure- valued 
state, which is in M x M. The intuition is that the remaining job sizes of 
those in service have the probability measure z^e, which is the equilibrium 
distribution of the job size distribution v. The total workload embodied in 
jobs that are in service is u) A Kjif. because at most K jobs are allowed in 
service. Dividing it by /3e gives the number of jobs in service. The remaining 
workload {w — K/3e)~^ = w — {w A KPe) resides in the buffer, where each job 
size follows the probability measure ly. Dividing this amount by /3, the mean 
of v, gives the number of jobs in buffer. 

Our main result requires that the limit in (2.20) satisfies 

(2.24) {C,f-i*) = ^K,uW*. 

A similar condition on the initial state is also imposed for proving a diffusion 
limit in queueing networks [6, 26]. When (2.24) does not hold, it is likely 
that some delayed versions of theorems are still true as in Theorem 3 of 
Bramson [6]; however, we will not pursue such generalization in this paper. 

Theorem 2.1. Assume (2.14)~(2.23). The sequence of diffusion scaled 
state descriptors 

{Q'-{-),Z'-{-))^Ak,uW*{-) asr^oo, 
where W*{-) is the reflected Brownian motion in Proposition 2.1. 

Corollary 2.1 (Piecewise reflected Brownian motion). Assume (2.14)- 
(2.23). The sequence of diffusion scaled system size process 

r-{.) = {l,Q^{.)+Z\.)) 

converges in distribution as r —t- oo to X*{-), where 

^.^,^jw(t)im*^w(t),.Kh ^^^^^^^ 

P Pe 

and W*{-) is the reflected Brownian motion as in Proposition 2.1. 

Proof. Since X'^-) = (1, Q'i-) + i'~(-)) and the mapping $ : M x M ^ 
M defined by $(i^i, 1^2) = (li 1^1 + 1^2) for any (i^i, z^i) G M x M is continuous, 
the result follows from Theorem 2.1 and the continuous mapping theorem. 
□ 
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Remark 2.1. In other words, X* (•) is a reflected Brownian motion with 
drift ^ and variance -^^r^ when it is above KPe and with drift and 

variance '^"'ti" when it is below K(3e. 

2.3. Outline of proof. The major step to prove our main result is to 
estabhsh the following state-space collapse result. 

Theorem 2.2. Assume (2.14)-(2.23). Fix T > 0. // (2.24) holds, then 

sup d[(Q^(t),i^(t)),A/^,^t^^(t)] ^0 asr^oo. 
t6[o,r] 

The state-space collapse result is appealing, since it rigorously shows that 
all performance processes can be described as a simple, deterministic func- 
tion of the workload process. We now use Theorem 2.2 to prove the main 
result. 

Proof of Theorem 2.1. We have the convergence of the workload 
processes ^"^{t) in Proposition 2.1. Since the mapping IS.k,u '■'^+ — )• M x M 
is continuous, by the continuous mapping theorem 

/^K,vW''{-)^ ^K,vW*{-) asr^oo. 

The result of the theorem follows immediately from the state-space collapse 
result in Theorem 2.2 and the "convergence together lemma" (Theorem 4.1 
in [4]). □ 

The proof of the state-space collapse is given in Section 5, but it requires 
ample preparation. Our proof is analogous to the framework developed in 
Bramson [6] for proving state-space collapse in multi-class networks with 
head-of-the-line service disciplines. The framework was later adopted for 
the PS queue in Gromoll [12], which the current paper closely follows. In 
Section 3, we establish several fundamental properties for the equilibrium 
behavior of the LPS fluid model introduced in [29]. Section 4 establishes 
precompactness of a family of shifted fluid scaled processes, which will be 
deflned in that section. Briefly speaking, the proof of the state-space collapse 
is built on the "richness" of the set of fluid limits, which are obtained from 
the shifted fluid scaled processes. Each fluid limit is shown to be a fluid 
model solution in Section 5.1. 

3. Convergence to equilibrium states for fluid model. We propose a fluid 
model, denoted by (K, A, v)^ to assist the study of the underlying stochastic 
processes for the LPS queue. The parameters K, A and u are the limiting 
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sharing level defined in (2.19), the limiting arrival rate defined in (2.15), and 
the limiting job size distribution defined (2.16), respectively. According to 
condition (2.15), (2.16), (2.17) and (2.23), we have that the traffic intensity 
of the fluid model 

(3.1) p = \f3 = l. 

Although u is required to satisfy (2.18) in Theorem 2.1, in this section 
only, we allow the job size distribution to have atoms. The fluid analogue 
of the LPS queue was first proposed and studied in [29], where general 
properties of the fluid model were studied for all traffic intensities p G [0, oo). 
For the purpose of this paper, we now recall the definition and some general 
properties for critically loaded fluid model. 

Given a measure- valued process {Q{-),Z{-)) £ D([0,oo),M x M), for t > 
0, let 

(3.2) Q{t) = {l,Qit)), 

(3.3) Z(t) = (l,Z(t)), 

(3.4) Xit) = Qit) + Z{t), 

(3.5) B{t) = Xt-Q{t). 

These quantities are the fluid analogues of Q{t),Z{t),B{t) and X{t) in the 
stochastic model. Define the fluid cumulative service amount up to time t 
by 



(3.6) S{t)= / (t>p{Z{T))dT, 

Jo 

where 

(3.7) </,^(x) = I 

[ oo, x = 0, 

when p=l- It worth noting that the function (j)p take a slightly different 
form when p^l, which is not the case in this paper. Interested readers are 
referred to [29] for detailed discussion. And for < s < t, denote 

(3.8) S{s,t)= f <l^p{Z{T))dT. 

J s 

An element (^, ^u) G M x M is called a valid initial condition if 

(3.9) ^ = ((i,^) + (i,^)_i^)+^, 

(3.10) {l,^l) = {{l,Q + {l,^l))^K. 
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Roughly speaking, validity of an initial state means that the initial state is 
consistent with the LPS policy; initial waiting jobs have the same job size 
distribution as arriving jobs. Denote 

(3.11) = {(^, /x) G M X M : (^, n) satisfies (3.9) and (3.10)} 

the set of all valid initial conditions. 

We now introduce the following fluid dynamic equations, which are anal- 
ogous to (2.5) and (2.6). For all Ay = {y,oo), y > 0, 

(3.12) QmAy) = C{Ay) + (Q(t) - QiO)MAy), 

(3.13) Z{t){Ay) = fi{Ay + S{t)) + / iy{Ay + Sis, t)) dB{s), 

Jo 

where Q(-), Z{-), X{-), B{-) and S{-) are defined in (3.2)-(3.8). They are 
subject to the following constraints: 

(3.14) B{-) is nondecreasing, 

(3.15) Q{t) = {X{t)-K)+, 

(3.16) Z{t) = {X{t) AK). 

Because (Q(-), ^(0) e D([0, oo), M x M), Q{-), X{-), Z{-) and ^(^ are right 
continuous on [0,oo) and have left limits in (0,oo). Here and later, the 
integral g{s) dB{s) is interpreted as the Lebesgue-Stieltjes integral on 
the interval [0,t], where by convention we set B{0~) = B{0). The above 
dynamic equations and constraints define the fiuid model {K,X,i'). 

Definition 3.1. (Q(-),Z(-)) G D([0,oo),M x M) is a solution to the 
fluid model {K, A, i') with a valid initial condition (^, ^u) if it satisfies the 
fluid dynamic equations (3.12) and (3.13), subject to the constraints (3.14)- 

(3.16) . 

Note that (2.17) and (2.17) imply that 

(3.17) ^<oo, 
and (2.18) implies 

(3.18) '^({0}) = 0, 

(3.19) ly is nonlattice. 

It has been proved in [29] (cf. Theorem 3.1) that under the conditions (3.17) 
and (3.18), there exists a unique fluid model solution (Q(-),Z{-)) for any 
valid initial condition (^,/x). Moreover, by Proposition 3.1 in [29], the fluid 
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workload process which is defined as W{t) = (X; 2(0 + -2(4)) satisfies the 
workload conservation property, that is, 

W{t) = {{x,^ + f^) + {p- for ah t > 0. 

Since we restrict to the critically loaded case, that is, p = 1, we have 

(3.20) W{t) = {x,^ + /u) for all t > 0. 

The main objective of this section is to show the following long-term behavior 
of the critically loaded fluid model, which helps to establish the state-space 
collapse in Section 5. 

Theorem 3.1. Assume (3.1) and (3.17)-(3.19). The unique solution 
(Q(-), to the fluid model {K^X^u) with a valid initial state (i^,/i) such 

that w = {x,S, + fJ-) < oo satisfies 

{Q{t),Z{t)) Ak,uW ast-^-oo. 

Moreover, for fixed constants p,M > the convergence is uniform for all 
fluid solutions with initial conditions in the set 

(3.21) ^yP, = {(^, ^) e ^ : (;^, ^ + ^) < M, e + /i) < M}. 

Section 3.1 characterizes the equilibrium states for the fluid model. Section 
3.2 presents the proof of convergence (the first half of Theorem 3.1), and 
Section 3.3 presents the proof of uniform convergence (the second half of 
Theorem 3.1). 

3.1. Equilibrium states. 

Definition 3.2. An element (i^,/i) G is called an equilibrium state 
for the fluid model {K, A, i') if the solution to the fluid model with initial 
condition (^,/x) satisfies 

(Q(t),Z(t)) = (e,/i) forallt>0. 

The simple intuition here is that if the fluid model solution starts with an 
invariant state, it will stay at this state forever. By the restarting lemma. 
Lemma 4.2 in [29], a fluid model solution will remain in an equilibrium state 
once reach it. Our first result is a characterization of an equilibrium state. 

Theorem 3.2. An element (^,/x) ^ ^ is an equilibrium state if and only 

if 

(3.22) fi) = /S.K,uW for some vu £ [0,oo). 
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Proof. Suppose fi) = Ak,uW for some w G [0, oo), we need show that 
iQ{-),Z{-)) = Ak,uW= I ly, — 

is the fluid model solution, w = 0, then by weak stability (Theorem 3.2 in 
[29]), Afc^jyO = (0,0) is the fluid model solution. So let us now focus on the 
case where w > 0. The fluid amount of jobs in buffer size and in service are 

0(*) = (1,2(0) = ^"-''^^^" 



Z{t) = {l,Zit)) 



w AKj3e 

/3e 



If Z{t) < K, then w < K/3e which implies that Q{t) = 0; if Q{t) > 0, then 
w > K/3e which implies that Z{t) = K. So condition (3.15) and (3.16) in 
Definition 3.1 are satisfied. Since Q{t) and Z{t) remain to be a constant, 
(3.14) holds trivially. This also implies that the fluid dynamic equation (3.12) 
is satisfied. It remains to verify the fluid dynamic equation (3.13). The fluid 
accumulative service amount 

^^^^ " 1(0) " WAK/3J 
since Z{t) is a constant. The right-hand side of (3.13) becomes 

Pe V wAKpe J Jo \ wAKPe J 

which equals ^^^^^Ue{Ay) = Z{t){Ay), for all y > 0. So (3.13) is verified. 
Thus, {Q(-),Z{-)) is the fluid model solution. 

Suppose that (^,/i) is an equilibrium state, we need to show that (C,/u) 
takes the form (3.22). If (C,/i) = (0,0), then trivially (^,/i) = Ak,uO- Let us 
now assume that / (0,0). Since (Q(-),^(-)) = (^,//) is the fluid model 
solution, the fluid dynamic equation (3.13) must be satisfied. That is, 

n{Ay) = fi( Ay + + X [ + ds, 



{l,fi)J Jo V ' (!>/"> 



for all y,t>0. This yields 



H{Ay)-fl( Ay + -^ ] = Ve{Ay)-vA Ay + ' 
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which imphes that /x = {l,fj,)ue due to the arbitrary of t and y. Since 
is a vahd state, = Let 

Again by vahdity of state {1,0 = ^"^'^'^^ and = So 

we conclude that = Ak^uW. □ 

3.2. Convergence to equilibrium states. We now identify conditions un- 
der which the fluid model solution starting at a valid initial state {(,,fJ,) will 
converge to an equilibrium state. 

If the initial condition /i) = (0, 0), then by weak stability (Theorem 3.2 
in [29]), the fluid model solution will always be zero. So (0,0) is an equilib- 
rium state. From now on, we focus on the case where the initial condition 
(^,^) / (0,0). By the fluid dynamic equation (3.12), Q{t)/3 = (x,Q(t)). It 
follows from the workload conservation property (3.20) that w = {x, C + = 
W{t) > ix, Q{t)) for all t > 0. So 

(3.23) Q{t) = {X{t) - K)+ < ^ for ah t > 0. 

Since W{t) = if and only if Z{t) = 0, 

(3.24) Z{t) = {X{t) AK)>0 for all t > 0. 

So the function S{-) as defined in (3.6) has an inverse on the interval [0, oo), 
which is denoted by T{-). By the inverse function theorem, 

f'{v) = Z{f{v)) forant;>0. 

According to (3.13) in Definition 3.1, we have 

Z{t) = /.(^s{t)) + /V - HS{s, t))] dB{s). 



Perform the change of variables u = S{t) and v = S{s) to get 

Z(r(n)) = fi{Au) + X [ [1-F{u- v)]Z{fiv)) dv 
Jo 

[l-F{u-v)]dQ{T{v)). 



f 

Jo 



10 

Note that the function Q{T{-)) has bounded variation since it is the dif- 
ference of two nondecreasing function B{T{-)) and Ar(-). According to the 
integration by parts formula provided by Lemma A.l, we obtain 



Z{T{u)) = ^(A) + A/3 / Z{T{u - v)) dFeiv) - [1 - F{0)]Q{T{u)) 

(3.25) ^° 

+ [l-F(u)]Q(0)+ / Qif{u-v))dF{v), 
Jo 



DIFFUSION LIMITS OF LPS QUEUES 



17 



where is the equihbrium distribution of F which can be written as F(,{x) = 
i /(f [1 - F{y)] dy. It foUows from (3.1) and (3.18) that p = 1 and F(0) = 0, 
so we obtain the foUowing key relationship: 

Q{f{u)) + Z{f{u)) = i{Au) + fi{Au) + r Q{f{u - v)) dF{v) 

In 

(3.26) 



+ 



Z{f{u-v))dF,{v) 



(3.27) 



for ah < u < oo. To simphfy notation, denote 

x{u) = q{u) + z{u), 
where 

(3.28) q{u) = Q{f{u)), 

(3.29) z{u) = Z{f{u)). 

By (3.15) and (3.16), the above equation can be written as 

x{u) = hi:,^{u)+ j {x{u-v) - K)^ dF{v) 

In 

(3.30) 



+ 



{x{u-v) AK)dFe{v). 



By Lemma A.l in [29], for any vahd initial condition (,^, /i), the above integral 
equation has a unique solution which is a cadlag function. Our analysis on 
the limiting behavior of fluid model solutions will be mainly based on (3.30). 

For a nonzero valid initial condition (^,/u) and an e G (0,1), define the 
e-perturbation of it by 



(e+e//,/i), if (i,/x) = i^,e = o, 
l(e+e(e+/^),/^), if^/o, 

and the —e-perturbation of it by 



ife = o. 



(1-e) 



(x,0 



1; 



+ l{i>£(x,S+M>/(x,«>} )' 



ife/0. 
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The simple idea behind this comphcated looking construction is that (a) the 
perturbed state (^e,^^) is still a valid initial condition, (b) the workload of 
the perturbed state satisfies 

(3.31) {x,Ce + ^^e) = {l + e){x,C + ^^) for all (-1,1), 

and (c) the function /igg,^^ which is defined based on {S,£,fi£) in the same as 
(3.27) satisfies 

(3.32) V„^_,(n)</i5,^(n)<%,^^(n) for all G M+, e G (0, 1). 

The complication in the construction on the perturbation comes from the 
requirement (3.31), which will provide convenience in the proof of Lemmas 
3.2 and 3.4. Inequality (3.32) will be used in the proof of the following 
lemma. Let x^(-) denote the solution to (3.30) with h^^^ replaced by h^^^f^^. 
We have the following comparison. 

Lemma 3.1. Assume (3.17), (3.18) and (0,0). For all e e (0,1), 

x~^{u) < x{u) < x^{u) for all u>0. 

Proof. Let u* = inf{n > 0:3;(ti) >x^{u)}. To prove x{u) <x^{u), it is 
enough to show that u* = oo. Note that x(0) = /i^,/i(0) < h^^^^^{Q) = x^(0). 
By right continuity of x(-) and x^(-), u* > 0. Now, suppose u* < oo. By 
(3.30) and (3.32) we have following bound estimation: 

x^(u*) — x{u*) 

(3.33) > / [{x^u* -v)-K)^ -{x{u* -v)-K)'^]dF{v) 

Jo 

+ / [{x%u* -v)AK)-{x{u* -v)AK)]dFe{v). 
Jo 

Assumption (3.18) implies that F{0) < 1. So there exists u' G (0,^*) such 
that 

/ dFe{v)>0 
Ju'-S 

for all < 5 <u' . By the definition of u* , we have that 

K = x^u* - u') - x{u* - u) > 0. 

By right continuity of x(-) and x^(-), we can choose 6 small enough such 
that 

x'^(f) — x{v) > — for all u€z [u* — u',u* — u + 6]. 
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K r' 

x^{u*)-x{u*)>- / dFe{v)>Q. 

This contradicts the definition of u* . So we must have that u* 
proof for the other inequahty is completely analogous. □ 

For the solution x{-) to (3.30) with initial condition {(,,fJ-), define 

(3.34) x{oo) = ^{w-Kl3e)^ + ^{wAKPe), 

P Pe 

where w = {x,S, + fJ-)- The quantity x(oo) can be interpreted as the fluid 
system size corresponding to the equilibrium state with workload w. We 
now use the above lemma and the key renewal theorem to show the following 
convergence. To help with the proof, we introduce the renewal function 

oo 

^(x) = ^F-(x), 

n=0 

associated with the distribution function F (see Section V.2 in [1] for detailed 
discussion) . 

Lemma 3.2. Assume (3.1) and (3.17)-(3.19). The solution x{-) to (3.30) 
with initial condition (^,/i) € and (x,C + A^) < satisfies 

x{u) ^ x{oo) as CO. 

Proof. We first study the case where w = {x,C + 1^) > ^Pe- Convolve 
both sides of (3.30) with, the renewal function U{-) of -F(-), to get 

X * U{u) = /ig,^ * U{u) + {x- i^)+ *F* U{u) + {xAK)*Fe* U{u). 

Since x = {x — K)~^ + (x A K), by moving all terms containing (x — K)^ to 
the left and all terms containing [x A K) to the right, we obtain 

(x(n) - K)-^ *{l-F)* U{u) = /i^,^ * U{u) - (x A K) * (1 - F^) * U{u). 

This gives 

(x(n) - K)^ = /i^,^ * U{u) - K{1 - Fe) * U{u) 

(3.35) 

+ [K-{xA K)] * (1 - Fe) * U{u). 

Both /i5,/x(-) and 1 — Fe{-) are directly Riemann integrable since they are 
nonincreasing and integrable functions. By the key renewal theorem, we 
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have the convergence of the first two terms on the right-hand side of (3.35): 

w 

lim h^,^*U{u) = —, 

u— >oo p 

lim K{l-Fe)*U{u) = ^. 

Note that ^ — > in this case, and the last term in (3.35) is always 
nonnegative. So there exists ui > such that 

{x{u)-K)^>0 foranti>tii. 

Equivalently, this means that K — {x{u) A K) = for all u>ui. So the last 
term in (3.35) is nonnegative and can be bounded above by 

/ Kd[{l - Fe) * Uiv)] = K[{1 - Fe) * U{u) - (1 - Fe) * [/(u - ni)], 

J U — Ul 

which converges to by the key renewal theorem. So in this case we have 
limt^oo ic(w) = K + =x(oo). 

In the case where w < K/de, we convolve both sides of (3.30) with Ue{-), 
the renewal function of -Fe(") to get 

X * Ue{u) = %^ * Ue{u) + {x- K)+ * F * Ue{u) + {x A K) * F^ * Ue{u). 

Again, since x= {x — K)^ + {xf\ K) , by moving all terms containing (x — A')"*" 
to the right and all terms containing [x A K) to the left, we obtain 

(3.36) {x{u) AK) = h^^^ * Ue{u) - {x - K)+ * (1 - F) * Ue{u). 

By the key renewal theorem, the first term in the above converges: 

w 

lim h^ ^ *Ue{u) = —. 

Ji-5>00 Pg 

Note that ^ — K < in this case, and the last term in (3.36) is always 
nonpositive. So there exists U2> such that 

(x(ii) A K) < K for aU u > U2- 

Equivalently, this means that (x(n) — K)^ = for all u>U2- The last term 
in (3.36) is nonnegative and, according to the upper bound (3.23), can be 
bounded above by 

r ^ d[(l - F) * Ue{v)] = |[(1 - F) * Ue{u) - (1 - F) * Ue{u - U2)], 
J U—U2 P P 

which converges to by the key renewal theorem. So in this case, we have 
limt^oo x{u) = f2 = x{oo). 
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Now it only remains to study the case where w = Kf^g. For any e € (0, 1), 
let (^gj/ig) denote the e-perturbation of the initial condition {(,,£), intro- 
duced before Lemma 3.1. It follows from (3.31) that 



Following from the discussion of our first case: 



lim {u) = K + 



By Lemma 3.1, x{u) < x^[u) for all n > 0. So for all e > there exists u'^ 
such that when u > u'l 



x(u) <K + 



s^eK 

/5 



■£ = K + 



/3 



+ 1 e. 



Similarly, we have the — e-perturbation (^_£,/U_e) for — e G (—1,0). It follows 
from (3.31) that 

W-e = ix, C-e + At-e) = (1 " e)l3eK. 

Following from the discussion of our first case, 

lim x~^{u) = K — eK. 

u—^oo 

By Lemma 3.1, x{u) > x~^{u) for all u > 0. So for all e > there exists u'2 
such that when u > 

x{u) >K-eK-e = K-{K + l)e. 
Summarizing this case, we have Ymit^oa x{u) = K = x{oo). □ 

Lemma 3.3. Assume (3.1) and (3.17)^(3.19). Let (Q(-),^(-)) he the 
solution to the fluid model {K,\,v) with initial condition {(,,fJ,) € and 
(X) C + A*) < oo- w = (x, IJ) ■ We have as t^ oo, 



(3.37) 
(3.38) 



sup 

j/6(0,oo) 



d 

Zit){Ay 



Qit),- ^^^z^ 



/3 

wAK^e 

He 



0. 



Proof. If u; = 0, the result holds trivially. Now assume that w; 7^ 0. Let 

{W - i^/3e) + 



g(oo) = (x(oo) — K) 



z(oo) = x(oo) A K ■ 



wAKPe 
He 



22 



J. ZHANG, J. G. DAI AND B. ZWART 



where a;(oo) is defined in (3.34). Based on the fluid dynamic equation (3.12) 
and the fact that is a probability measure, we have 

m)iA) - q{ooMA)\ = \[Qit) - q{ooMA)\ < |Q(t) - g(oo)|, 

for all Borel set A. This implies that 

Qit){A) < q{ooMA) + \Qit) - q{oo)\ < g(oo)z.(AlQW-«(-)l ) + \Qit) - q{oo)\, 

where A'^ denote the ^-enlargement as introduced in Section 1.1. Similarly, 
we have 

q{ooMA) < Q(t)(Al^W-'?(°°)l) + \Q{t) - q{oo)\. 

By the change of variable u = S{t) [t = T(u)] and the definition of the Pro- 
horov metric, 

d[Qit),q{^)i^]<\qiu)-q{oo)\. 

By Lemma 3.2, there exists ui > such that when u> ui we have \q{u) — 
9(00)1 < £. So for all e > 0, there exists ti = Kui > T{ui) such that 



(3.39) 



d[Q{t),q{oo)L']<e foralH>ti. 



It remains to study the limiting behavior of Perform the change of 
variable u = S{t) (t = T(u)) to the fluid dynamic equation (3.13), we get 



Z{T{u)){Ay) = n{Ay + u)+ u{Ay + u - v) d[XT{v) - q{v)]. 





Due to the fact that p= 1, we have ^ = A. Thus, z{oo)ue{Ay) = A ^{Ay + 

u — v)z{qo) dv + z{oo)V(,{Ay + u). Since dT{v) = z{v) dv, we then have the 
following bound estimation: 

\Z{f{u)){Ay)-z{oc)uMy)\ 



< H{Ay +U) + 



(3.40) 



iy{Ay + u — v) dq{v) 



+ 



pu 

I / ^{Ay + u — v)[z{oo) 
Jo 



z{v)] dv 



+ z{oo)h'e{Ay +u). 



It is clear that the first and the last terms on the right-hand side of (3.40) 
vanishes as n — t- 00 . Recall that F is the distribution function corresponding 
to the measure i'. By integration by parts (see Lemma A.l), the second term 
on the right-hand side of (3.40) can be written as 

[1 - F{y)]qiu) - [1 - F{y + u)]g(0) + / qiv) dF{y + u-^ 

Jo 
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which is less than or equal to 

I [1 - F{y)]q{u) - [F{y + u)- F{y)]q{^)\ + \[l-F{y + u)]g(0)| 

\q{u -v) - q{oo)\ dF{y + v). 

By convergence of x{-), for all e > there exists a ui such that \x{v) — 
a;(oo)| < e if V > ui. For all e > 0, we can choose U2> such that 1 — F{u2) < 
e. When u > ui + U2, the above inequality can be further bounded by 



[l + g(0)+(?(oo)]e + 



\q{u -v) - q{oo)\ dF{y + v) 



+ 



l{u -v)- q{oo)\ dF{y + v) 



U — Ul 



< [1 + q{0) + q{oo)]e + -ui + y)- F(y)]e 
+ sup|(?(u) — q{oo)\[F{u) — F{u — ui)] 

where the last inequality is due to (3.23). When u>u\ +ti2, the third term 
in (3.40) can be written as 



A / v{Ay^u — v^yzioo) — z{v')\dv + \ \ v(^Ay^u — v)\z{<X)) — z{v)\dv 

Ul 



which is bounded above by 

A sup \z{v) - z{oo)\[l- F{u-ui)]+eX I [1-F{v)]dv 



0<v<ui 

< XKe + A/3e, 



Ul 



where the last inequality is due to the bound z{u) < K for all u > 0. So for 
all e > there exists a t2 = K{ui + U2) > T{ui + U2) such that 

(3.41) sup \Z{t){Ay) - z{oo)ve{Ay)\ < £ foralH>t2- 

y6(0,oo) 



□ 



Proof of Theorem 3.1, part I. Note that (x, '^^pf' ^e) < Kf3e < 
00. By the workload conversing property, {x,Z{-)) <w < 00. According to 
Lemma C.l, (3.38) in Lemma 3.3 implies that 



- wAK^e 

^(*)> o 

Pe 







as i — )• 00. 



This and (3.37) implies the convergence result in Theorem 3.2. □ 
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3.3. Uniform convergence to equilibrium states. The convergence in the 
previous subsection depends on the initial condition We now show 

that the convergence is uniform for all initial conditions in the set 
defined in Theorem 3.1. 

To emphasize the dependency on the initial condition, we use T(j^^j) 
to denote the set of solutions to equation (3.30) with input function h^^^ 
induced by initial condition (Ca*) ^ -*^m' ^^"^ '^("^ti) ^° denote the set of 
solutions to the fluid model (i^, A,z^) with initial condition (^,^) G '^m- 

Lemma 3.4. Assume (3.1) and (3.17)-(3.19). For each e > there exists 
an I* > such that when u>r, 

sup \x{u) — x{oo)\ < e. 

Proof. To prove this lemma, we need to adjust the proof of Lemma 3.2 
with the assistance of Lemma B.l. 

Let J^M = '■ iCjfJ') S '^m}- the definition of the set in Theo- 
rem 3.1, is the set of nonincreasing functions satisfying condition (B.l) 
and (B.2) in Lemma B.l. For any e > 0, divide the set into three parts, 



where 



J: 



{(e, /i) G : (X, C + M> > i^/3e(l + e)}, 

{(e,/i)G J^i:f:(x,C + M><i^/3e(l-e)}, 

and^o^^J,\(^+U^-). 

We first focus on the set . By doing the same algebra as in the proof 
of Lemma 3.2, we see that (3.35) holds for any (^,//) G ■ By Lemma B.l 
and the key renewal theorem, there exists a ti^ such that 



sup 



V(u) 



K{1 



Fe) * U{u) - 



for all u > Up So for the first two terms on the right-hand side of (3.35), we 
have 



/ig,^ * U{u) - K{1 - Fe) * U{u) > 



/5 



4 



2f3 



e>0, 



for all ('^,/i) G and u > u^. Note that the last term in (3.35) is always 
nonnegative. So when u > we have {x{u) — K)~^ > [or equivalently K — 
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{x{u) A K) = 0], for all {(,,fJ,) € ■ So the last term on the right-hand side 
of (3.35) is nonnegative and can be bounded above by 

Kd[{l - Fe) * U{v)] = K[il - Fe) * U{u) - (1 - Fe) * U {u - ul)], 

which converges to as u — )■ oo by the key renewal theorem. So there exists a 
u'^ > such that when u> u'^, the absolute value of third term on the right- 
hand side of (3.35) is bounded by ^^£- Let II = max(u'^,u|). By (3.35) and 
summarizing the above, we obtain 

sup \x{u) — x{oo)\ < — for all « > /jl'. 

Next, we consider the set ■ By doing the same algebra as in the proof 
of Lemma 3.2, we see that (3.36) holds for any {(,,fJ-) G ■ By Lemma B.l, 
there exists a U2 such that 



sup 

for all u> So we have 



K/3e{l-e) , K 



K 



* Ue{u) < + -e<K, 

for all ('^,/i) G and u > Note that the last term in (3.36) is always 
nonpositive. So when n > we have x{u) < K [or equivalently, [x{u) — 
K)'^ = 0] for all (^,/i) S . So by (3.23), the absolute value of the last 
term on the right-hand side of (3.36) can be bounded by 

^ d[(l - F) * Ue{v)] = ^[{l-F)* Ue{u) - (1 - F) * Ue{u - U*^)], 
u-u* P P 

which converges to as u —t- 00 by the key renewal theorem. So there exists 
a n2 > such that when u> the last term on the right-hand side of 
(3.36) is bounded by ^e. Let I2 = max(M2i ^^2)- -^y (3.36) and summarizing 
the above, 

sup \x{u) — x{co)\ < K e foralln>/2. 

It only remains to deal with the set J^^ . We can restrict e < 1/3, since we 
are only interested in small ones. According to (3.31), for any (^,/i) S J^^?, 
we have h^.^^^^.^^ £ J'^ and /i^ ^^^^ g^ e J'~ . Denote x"'"(-) and x~(-) the 
solutions to (3.30) corresponding to h^^^^^^^ and h^_^^^fj__^^, respectively. By 
Lemma 3.1, 

x~ (u) < x{u) < x'^{u) for all ti > 0. 
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Note that in this case, the workload w < {1 + e)(ieK < 2f3eK. By (3.34), we 
have that 

1 1 

1 1 



x~''(oo) < x(oo) + max 



Sew < x(oo) + max 



X (oo) > x{oo) — max 



Sew > x(oo) 



max 



(/3'/5e) 



Ql^eKe, 
6f3eKe. 



According to the above two cases, when u> I* = max(Z*, /2), 



x{u) < x~'"(oo) + 



■e < xioo) + max 



x{u) > X (oo) — Ke > x{oo) — maxf — , — j 
for all {^,fi) G J^(P. This means that 



G^eKe - Ke, 



sup \x{u) — x{oo)\ < Ce forallti>/*, 

where C = max(|,^)6/3eK + ^ + i^. □ 

Lemma 3.5. Assume (3.1) and (3.17)-(3.19). For all e > there exists 
an L* > such that when t> L* , 



(3.42) 
(3.43) 



sup d 

(Q(.),5(-))6HG^X/) 



sup 



sup 



(S(-),^(-))eS(^^',)j/e(o,cxD) 



Z{t){Ay 



/3 

wAKPe 



MA 



<e, 



< e. 



Proof. The proof of this corollary is almost the same as the proof of 
Lemma 3.3. Just note that by Lemma 3.4, the ti in (3.39) and the t2 in 
(3.41) are good for all (^,/i) G J^lj. With L* = max(ti,t2), the result of this 
lemma immediately follows. □ 



Proof of Theorem 3.1, part IL Now we use Lemma 3.5 to show the 
uniform convergence result. Note that (x, '"'^pf' T^e) < K/3e < oo. By the def- 
inition of J^lf, for any {Q.{-),Z{-)) G H(j^|f), {x,Z{-)) < M < oo. According 
to Lemma C.l, (3.43) in Lemma 3.5 implies that for all e > there exists 
an such that when t > , 



sup d 

(Q(.),2(-))eS(^P) 



2^[t), o 

Pe 



< e. 



The uniform convergence follows from the above and (3.42). □ 
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4. Shifted fluid scaling and precompactness. The objective of this sec- 
tion is to show the precompactness property, Theorem 4.1 at the end of this 
section, for the sequence of shifted fluid scaled processes, which is defined in 
the following section. 

4.1. Shifted fluid scaling. Much of our understanding of the diffusion 
scaled process will be derived from results about the shifted fluid scaled 
process, which is defined by 

(4.1) Q"''"(t) = ^Q"(rm + rt), Z^'^Ct) = ^Z"(rm + rt), 

for all m G N and t > 0. To see the relationship between these two scalings, 
consider the diffusion scaled process on the interval [0, T] , which corresponds 
to the interval [0,r^T] for the unsealed process. Fix a constant L > 1, the 
interval will be covered by the [rTj + 1 overlapping intervals 

[rm,rm + rL], m = 0,1, [rT\. 

For each t S [0, T] , there exists an m G {0, . . . , [rTj } and s G [0, L] (which 
may not be unique) such that r'^t = rm + rs. Thus, 

(4.2) Q'-(t) = Q"'™(s), Z'{t) = Z^'^^is). 

This will serve as a key relationship between fluid and diffusion scaled pro- 
cesses. 

We are also interested in shifted fluid scaled versions of other processes, 
like the workload and system size processes. Note that Q^{-), Z''\-), X'^{-), 
W^i^-) and S'^{-,-) are actually functions of {QJ" {■) , Z^ {■)) , so the scaling for 
these quantities is defined as the functions of the corresponding scaling for 





•)), that is. 




(4.3) 


Q^'™(i) = 


(l,Q-.-(t)) = lQ'-(rm + rt), 
r 


(4.4) 


Z^'™(i) = 


(l,J'^''"(i)) = -Z7rm + rt), 
r 


(4.5) 


X'^'™(t) = 


(1, Z''''^{t) + J^'™(t)) = -^'■(rm + rt) 

r 


(4.6) 


W'^'^it) = 


ix, Q''"(i) + Z'-'^^it)) = -W'\rm + rt 

T 



for all < s < t. We define the shifted fiuid scaling for the arrival process as 

(4.7) E''''^{t) = -E''{rm + rt), 

r 

for ah t > 0. By (2.3), the shifted fiuid scaling for B''{-) is 

(4.8) S"''"(t) = E"'™(t) - g"'™(t). 
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for all t > 0. To shorten the notation, for all < s < t, denote 

(4.9) E'^''^{s,t) = E''"'{t)- E''''^{s), B''''^{s,t)=B'-'''\t)-B''^''\s). 

A shifted fluid scaled version of the stochastic dynamic equations (2.5) 
and (2.6) can be written as, for < s < 

Q^,-(,)(A) + i Yl 
-\ E %(^)' ^^[0,oo), 

i=r_B''.'"{s)+l 

^''■'"'(s)(^ + 5'''(rm + rs, rm + rt)) 
+ 7 E 5<(^ + 5'(rr,rm + rt)), 

i=r_B'-."i(s)+l 

(0,oo). 

Please note that ^''''"(t)({0}) = for all i > according to our definition. 
The dynamics of the system is determined by the above equations. Equation 

(4.10) says that the status of the buffer at time t equals the status at time 
■s plus what has arrived to the buffer and minus what has left from the 
buffer during time interval (s, . Those jobs who left buffer enter service; the 
service process has been taken care of by shifting the set A by the cumulative 
service amount S'^{Ti,rm + rt) that the ith job receives. This corresponds 
to the second term on the right-hand side of (4.11). This plus the status at 
time s shifted by accumulative service amount S^'{rm + rs,rm + rt) is equal 
to the status of the server at time t, as indicated in (4.11). 

4.2. Preliminary estimates. We first establish some bounds which will 
be useful for later discussion. The following lemma gives some bound on the 
arrival processes. 

Lemma 4.1. Assume (2.14) and (2.15). Fix T > and L > 1. For all e, 
e' > 0, there exists an ro such that whenever r>rQ, 

(4.12) P^f max sup |£;^'™(s, i) - A(t - s)| > e') < e. 

Vm<[rrj 5_tg[0^L] / 

Proof. Let t' = ^ and s' = Note that max^<L.rTj sup^gjQ^^] ^ < 
T + 1 for all large r, and < s, t < L is the same as \t' — s'\ <L/r. For any 



Q'''^{t){A) = 

(4.10) 

^"''"(t)(A) = 

(4.11) 
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6 > 0, there exists an Tq such that L/r < 5 for ah r > rg, so the left-hand 
side of (4.12) can be bounded above by 



(4.13) F"" 



( sup -E'-irH') - Xrt' - (-E'-{rh') - Xrs'] > e'] 

\s',t'e\o,T+i],\s'~t'\<s r \r J J 



for ah r > Tq. By the assumptions (2.14) and (2.15) on the arrival process, 
{^E{r^-) — Xr-} converges in distribution to the Brownian motion E*{-). 
Since a Brownian motion is almost surely continuous, we conclude that (4.13) 
converges to zero as — )• 0. Then the inequality (4.12) follows immediately. 
□ 

Here is a remark that will facilitate some arguments later on. The e' and 
e in (4.12) can be replaced by SEir), which is a function of r that vanishes 
at infinity. Here is the proof. For each index r let 

Hr = {6>0: (4.12) is true for e' = e = 5}. 

Clearly, Hr is not empty since 2 S Hr- Let eE(r) = inf iJ^ for each r > 0. 
Assume that £E{f) does not vanish at infinity. There exists a (5 > and a 
subsequence {r„}^^ which increases to infinity such that 

(4.14) es(r„)>5 for all n > 0. 

However, by Lemma 4.1, for e' = e = 5/2 there exists an such that when 
'"n ^ "Ts, (4.12) must hold. This contradicts (4.14). Based on this, we con- 
struct 

(4.15) ^E = { max sup \E''^'^{s,t) - X{t - s)\<eE{r)\. 

According to Lemma 4.1, we have that 

(4.16) lim P^(rj^) = 1. 

r— >oo 

Recall the Glivenko-Cantelli estimate in Lemma D.l. By the same ar- 
gument as in the above, for fixed constant Mi,Li, there exists a function 
£gc(')5 which vanishes at infinity, such that the probability inequality in 
Lemma D.l holds with e and e' replaced by this function. In other words, if 
we denote 

QJqq{Mi,Li) = \ max sup sn^\{f,if{n,l))-l{f,u'')\ 

(4.17) 

where ff'{n,l) is defined in (D.l) and Y is defined in (D.5), then for any 
fixed constant Mi,Li, 

(4.18) \\uir{n}.c{Mi,L{)) = l. 

r^oo 
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Now, we use the above result and Proposition 2.1 to obtain a bound on 
the queue length processes. 

Lemma 4.2. Assume (2.U)-(2.17), (2.20), (2.21) and (2.23). FixT>0 
and L > 1. For all rj > 0, there exists a constant M > such that 

liminf P*" ( max sup Q'''™(t) < > 1 - ry. 

r^oo Vm<Lr-TJig[o,L] / 

Proof. Since < T + 1 for all large enough r, it is enough to 

prove the following inequality: 



r— >oo 



liminfPM sup Q'' (t) < M ) > 1 - r]. 

He[0,T+l] 



Suppose this is not true, then there exists an r/ > such that for any M, 



hm inf P'' sup Q'' (t) > M ) > r]. 

'■^"^ ^te[o,T+i] ^ 

Denote the event in the above probability by By the stochastic dynamic 
equation (2.5), we have 



-Q{rH){A) = - 6.riA). 

i=B^{r'^t)+l 



Since z/ is a probability measure on M+, there exists an a > such that 
v{a,oo) > 0. We have the following inequality from the dynamic equation 
(4.10): 

(4.19) -W''{rh)>a-Qr{rH){a,oo)>- V 5^r{a,oo). 

fy* ^^^^^ % 

i=B'- {r'^t)+l 

For any r, on the event fi^ there exists a ti G [0,T + 1] (random and de- 
pending on r) such that 

1 



-Q'{rHi)>M. 
r 



By (4.15), on the event 0^, 



sup E''{r^t)<2Xr^{T + l), 

tG[0,T+l] 

for all large enough r. Let Mi = max(M, 2AT) and Li = M. By (4.17) and 
(4.19), on the event -^i) ^ ^i? ^ ^i' 

W'\ti) > aMv'' {a, oo) - 1 > aMv{a, oo) - 2, 
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for all large r. By (4.16) and (4.18), we have for each M > 0, 



r—^oo 



liminfPM sup W (t) > aMiy{a,oo) - 2) > i]. 
He[o,T+i] 



This contradicts the result in Proposition 2.1. □ 

The following lemma gives a bound on the (1 + p)th moment of the 
measure-valued process, where p is the same as in conditions (2.17) and 
(2.21). 

Lemma 4.3. Assume (2.14)-(2.17), (2.19)-(2.21) and (2.23). FixT>0 
and L> 1. For each r]> 0, there exists a constant M > such that 



r— ^oo 



liminf PM max sup {x^+p, Q^'™(t) + Z'''"\t)) < M > 1 - ?/. 



Proof. By condition (2.21), 

hminfP'-f /x^+^-Q^(0) + -Z^O)) < (x^+^t +/^*) + l]=l. 

Denote the event in the above by Oq. By Lemma 4.2, for any ?] > 0, there 
exists a constant M' > such that 

liminfP''( max sup -(5''(rm + rt) < M'j > 1 - 77/2. 

r^oo \m<\rT\t(.[Q^^r ) 

Denote the event in the above by Vl\{M). Fix Mi = max(M', A(r + 1)) and 
Li = A(L + 1) + 2M'. By Lemma D.l, 

hm P'-(O^Gc(^i,ii)) = l- 
1 — ^00 

To prove the lemma, it suffices to show that there exists an M > such that 
on the event n ^\{M') n ^'^^(Mx.Lx) n O^, 

max sup /y^+*', -Q''(rm + rt) + -2:''(rm + rt)\ < Af, 
™<Lr-TJte[o,L]\ r r I 

for all large r. In the remainder of the proof, all random quantities of 
the rth system is evaluated at a sample path in the event n Vt\(M'^ n 

We first find a bound for maXm<|^rTJ supig[o,L] (X"^"''^) f Q''(''"i + rt)). By 
the dynamic equation (2.5), we have that for all m < [rTj and t £ [0,L], 

/ E-{rm+rt) \ 

^l+P^_gr(^^ + rt)\ = /x'+^- Yl 

' \ B^{rm+rt) I 
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By (4.15) and the definition of we have 

(4.20) max sup E'' {rm + rt) < Xr'^{T + 1) <r'^ Mi, 

m< \rT\ t6[o,L] 

(4.21) max sup Q''{rm + rt) < rM' < rLi 

m<\rT\ te[o,L] 

for all large enough r. So 

max sup (\^^^,—Q^{rm + rt)\< sup {'x^'^^ ,ff {n,Li)) . 

By (D.5) in the remark after Lemma D.l, the function x^~^^ 6 which 
appears in the definition of Qqq{Mi, Li). So by (4.17) 

max sup {x'+P,Q'^'^{t))<Li{x'^P,un + l/2. 

m<lrT\ t£[0,L] 

It then follows from condition (2.17) and Theorem 25.12 in [3], we have 
(x^"*"^) ^'') ~^ {x^~^^, u) as r ^ oo. Thus, 

max sup (x^+^Q^'™(t))<Li(/+^^^) + l, 

m< lrT\ te[o,L] 

for all large r. 

We now look for a bound for raaXrn<[rTi sup(g[o^i] (x^"*"^) :^^''(^''^ + '^*))- 
It follows from the dynamic equation (4.11) that for any m < [rTj , t € [0, L] 
and Borel set A C , 

-Z''(rm + rt)(A) 
r 

= -Z''(rm + rt)(An(0,co)) + -Z'"(rm + rt)({0}) 
r r 

= -Z''(0)(A n (0, oo) + 570, rm + rt)) 
r 

m-l B-(r{m-j)) 

+ % (^ n(0,oo) + 5^ (r[,rm + rt)) 

j=0 i=B^(r{m,-j-l))+l 
B^{rm+rt) 

+ - Yl % (^ n(0,oo) + 5" (r[,rm + rt)). 

i=B'-(rm)+l 

Given < j < m — 1, for those i's with B'^{r{m — j — 1)) < « < B'^{r{m — j)) 
we have 

r[ G [r(m- j - l),r{m-j)]. 
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Let's first consider the case where Z'^{s) > for all s G [0,rm + rt]. In this 
case, by (2.2), the cumulative service amount 

S"" {t- ,rm + rt) > S'' {r{m - j),rm) > > J^, 

for all large r where the last inequality is due to (2.19). For those i's such that 
larger than B^{rm), we use the trivial lower bound S'^{T[,rm + rt) > 0. 
Also take the trivial lower bound that S'"(0, rm + rt) > 0. Then we have the 
following inequality on the (1 +p)th moment: 



(4.22) 




Now, we consider the case where there exists an s G [0,rm + rt] such that 
Z^{s) = 0. In this case, let mo = min{0 < j <m: there exists an s G [r(m — 
j — l),r{m — j)] such that Z'''(s) = 0}. Pick a point sq G [r{mo— j — l),r{mo — 
j)] with Z^'{s()) = 0. Then we can replace time in (4.22) with sq and only 
consider intervals [r(m — j — 1), r(m — j)] with j < mo — 1. So we have 



(4.23) 




It is clear that the upper bound in (4.23) is less than or equal to the upper 
bound in (4.22). So we only need to focus on (4.22) to estimate an upper 
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bound for the (1 + p)th moment. By (4.20) and (4.21), for all m < [rT\, 
t £ [0,L] and all large r, 

-rM' < B''{rj) < Xr'^iT + 1) < r^Mi 
Q<B''{rj + rt)- B^'irj) 
< Ar (L + 1) + 2rM' < rLi for all i G [0, L] . 

It then follows from (4.22) that 



(4.24) 



-rMi<n<r^Mi j^q 



+ sup {x^+P,f{n,Li)). 

-rMi<n<r^Mi 

The first term on the right-hand side of the above is bounded by 1 + {x^^^, 
C + A**) by the definition of fig. Again, due to (4.17), condition (2.17) and 
Theorem 25.12 in [3], the third term on the right-hand side of the above is 
bounded by 

(4.25) L^{x'-'P,un + 1/2 < L,{x'+p,u) + 1, 

for all large r. It now only remains to deal with the second term on the 
right-hand side of (4.24). Let 

F;;{x)=f{n,Li){{x,oo)) forana;>0. 

The summation in the second term on the right-hand side of (4.24) can be 
upper bounded by 



F:(x)dx 



l+P f^JU-l)/(2K) Jy 
-| poo poo 

^T— / {x-yYF:^{x)dxdy. 
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Applying Fubini's theorem, the last bound in the above equals 

1 POO rx 1 roo 

(x- vYFl {x) dy dx = / x^+^F; (x) dx 



^+pJo Jo ' (l+p)2 

2+p 



{x^^\f{n,Lr)). 



Since the function x^"*"^ ^ ^) it again follows from (4.17), (2.17) and The- 
orem 25.12 in [3] that the second term on the right-hand side of (4.24) is 
bounded by 

+ 1/2 < ^L,(x^+^.) + 1, 

for all large r. The proof of this lemma is completed by summing up all 
these upper bounds. □ 

The following proposition summarizes the bound estimates in this section. 



Proposition 4.1. Assume (2.14)-(2.17), (2.19)~(2.21) and (2.23). For 
any r]> 0, there exists a constant M > and an event 0^(M) for each index 
r such that 

(4.26) liminf P''(Q^(M)) > 1 - ry, 

r—^-oo 

and on the event lo G f]^(M), we have 

max sup Q^'™ (i) < M, 

m< lrT\ te[Q,L] 

max sup W'''"^{t) < M, 

m<lrT\ t6[o,L] 

max sup Q"''"(t) + Z^'^'it)) < M. 

m< lrT\ te[0,L] 

Proof. The first and the third inequality follow from Lemmas 4.2 and 
4.3. The second inequality follows from Proposition 2.1. □ 

4.3. Compact containment. Recall that a set K C M is relatively com- 
pact if 

sup ^(M+) < oo, 

and there exists a sequence of nested compact sets Jn C M4. such that \JJn = 
M+ and 

lim sup^(J^) = 0, 
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where denotes the complement of J„; see [17], Theorem A7.5. We estab- 
hsh the following relative compactness property using the bound estimates 
in Section 4.2. 

Lemma 4.4. Assume (2.14)^(2.17), (2.19)-(2.21) and (2.23). FixT>0 
and L > 1. For each r] > there exist a constant M > and a relatively 
compact set K(M) C M such that for all uj G il^(M) (which is introduced 
in Proposition 4-1) o-nd r € M_|_, 

Q^-'^Cw,*) GK(M) and ^"^'"(w, t) G K(M) 

for all t £ [0, r] and m < [rTj . 

Proof. Let 

K(M) = G M:^(]R+) < M and C((n,oo)) < M/n^+P}. 

Clearly, K(M) is a relatively compact set for any constant M > 0. Note that 
Q^'™(a;, t)(M+) is bounded by M for ah m < [rT\ , t G [0, T] and lo G J1b(M). 
By the Markov inequality, for any t > 0, m< [rTj and oj G r2^(M), 

/yl+P Q'''"^(u t)) 

Q^'-(a;,t)((n,oo)) < ' j+/ ' 

which is bounded by ^^ttf by the definition of r2^(M). 

Note that ^^''"(w, t)(M+) is bounded by K^'/r by the policy constraint 
(2.8). By condition (2.19), /r <K + 1 for all large r. The same argument 
of Q'^'"^(a;, t) applies for ^'•'"(w, t). □ 

4.4. Asymptotic regularity. A similar result as in this section was proved 
in [29]. However, here we consider a much longer time horizon [0, [rTj + L] 
instead of interval [0,T] in [29]. The proof of the following result use a 
combination of ideas in [13] and [29]. 

Lemma 4.5. Assume (2.14)-(2.23). Fix T > and L > 1. For each 
e,ri > there exists a k>0 (depending on e and r]) such that 

(4.27) liminf P'Y max sup sup Z'''"'{t){[x,x + K])<e)>l- r/. 

r->oo Vm<L^TJtg[o,l,]x6lR+ ^ 

Proof. To prove (4.27), it suffices to show 

liminfP'"( sup sup Z'~'°{t){[x,x + k]) < e) > I - rj. 

First, we have that for any e,rj> 0, there exists a k such that 

(4.28) liminfP''/' sup ^'"'°(0)([a;, x + k]) < e/2) >1 - r]/2. 
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The proof of this inequahty, which is based on (2.22), is exactly the same as 
the proof of (5.14) in [29], so we omit it for brevity. 

Now, we need to extend this result to the interval [0, [rT\ + L] . Denote 
the event in (4.28) by Let 

(4.29) W = n n ^BiM) n n'^cC^XT, 2M). 

By (4.16), (4.18) and (4.26), there exists an M > such that 

liminfP^(0^(M)) > 1 - ry. 

In the remainder of the proof, all random objects are evaluated at a fixed 
sample path in ^V^^i^)- 

For any r > 0, t G [0, [rTj + L], we define the time 

to = sup{{s < t : (1, Z^'°(s)) < e/A} U {0}} 

to be the last time before t that the fluid-scaled number of jobs in service is 
less than e/4. Let 

/ AMK\ 
ti = max! to, t I . 

We have the following three cases for discussion. 
If ti = 0, then by (4.28) for each x G M+ 

Z'''^{ti){[x,x + k] + S'{rti,rt)) < e/2. 

If ti = to > 0, then for each 6 £ (0, ti) there exists an s G (ti — 6, ti] such that 
Z^'^(s)(K^) < e/4. Since we are only concerned with small e [which should 
be small enough such that Z^'^{s) < e/4 < K'^ /r], Q^'^{s) = by the policy 
constraint (2.8). Note that (2.3) implies 

(4.30) 5"'°(s,t) <^'''°(s,t) + Q'-'°(s) foralls<t. 

By (4.15), we have B'''^[s,ti) < X6-\-e/A for all large r. For any Borel set 
A C M_|_, by the fluid scaled system dynamic equation (4.11), 

^^'°(ti)(A) = ^^'0(ti)(An(0,oo))+^^'0(ti)({0}) 

< ^'^'0(s)(M+) + B^'^s, ti) < e/4 + X6 + e/4, 

which can be made smalled than e/2 by choosing 6 suitably small. 

If ti = t— ^-^^ > 0, then since the sharing limit is K^' , we have S"'(rti, rt) > 

iMKr > 2M i^^gg ^_ 



Z''\t{){[x, x + k]+ S'-{rti,rt)) < Z''^{ti) 



2M , , 
— ,oo ) ) <e/2. 
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where the last inequality is due to the Markov's inequality and the definition 
of r2^(M). To summarize, we have 

(4.31) J^'°(ti)([x,x + K] +5^(rti,rt)) <e/2. 

By the fluid scaled stochastic dynamic equation (4.11), 

Z^'O {t){[x,x + K]) = Z'-'"' {ti){[x,x + K] + S'{rti,rt)) 

(4.32) 

^ rB''''-\t) 

+ - ^ 5^r([x,x + K] +5'"(ri,rt)), 

j=rB'-.0(ti)+l 

for each x > 0. When x = 0, we have 

z^\tm ^]) = z'-'^tm, k]) + j^'°(t)({o}) 

= Z'-'\tM'^,K]+S'\rt^,rt)) 

+ - E %((0,K] + 5^(r„rt)), 

i=r_B'-.0(ti)+l 

< J'-'0(ti)([0,Aj]+5^(rti,rt)) 



+ - E <5<([0,K] + 5^(ri,rt)). 



j=rB'-.0(ti)+l 

Since all we need is an upper bound estimate, we stick with (4.32) for analy- 
sis. By the choice of ti, the first term on the right-hand side (4.32) is always 
upper bounded by e/2. Let / denote the second term on the right-hand side 
of the proceeding equation. Now it only remains to show that I < e/2. 
Let ti < t2 < ■ ■ ■ < t]^ = t be a partition of the interval [ti,t] such that 
— tj\ < 5 for all J = 1, . . . , — 1, where 5 is to be chosen below. Note 
that by the definition of ti, 

4MK 

4.33 N<— — . 

oe 

Write / as the summation 

I=Yj- E S^r{[x,x + K] + S''{Ti,rt)). 

j=l i=rB^'0{tj)+l 

Recall that t[ is the time that the zth job starts service, so rtj < t[ < rtj-^-i 
for those i G [rB'''^{tj) + 1, r^'"'°(tj+i)]. This implies that 

S'^irtj+urt) < S'{Turt) < S^rt^^rt). 
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By the definition of ti, we have Z^'^{s) > e/4 for all s G This gives 

4(5 

S''{rtj,rtj+i) < — . 

So for any i G [rB^'O(tj) + 1, rB'''^{tj+i)], we have [x, x + k] + S^'in, rt) C Cj, 
where 



Thus, 



4(5' 

X + S"" (rtj+i ,rt),x + K + S''' {rtj+i ,rt) + — 



i=l i=rB^-0{tj)+l 

By (4.15), (4.30) and the definition of ^e have for all j = 1, . . . , iV - 1 



rM < rB'''^{tj) < r{XrT + L + 1 + M) < r^2AT, 



B'''''{tj , tj+i) <XS + 1 + M< 2M, 

where the last inequality in each of the above bound holds because we only 
care about small 5 and large r. Choose ei = tMtjf- By (4.17), 



for all large r. This implies that 

Let £2 = s{X4:MK%+M+i) ' Since C^*^^ is a close interval with length k + ^ + 
^£2, by condition (2.18), we can choose < 1 small enough such that 

where CJ^ is the £2 -enlargement of Cj. By (2.16), we also have 

l^'{Cj) < uiCp) + ^£2 < l^iCp) + £2, 

for all large enough r. Thus, we conclude that 

N-l 

I<2e2Y[B^''it,^,)-B^''it,)]+Ne^ 

<2£2[5'-'0(t)-5'-'0(ti)]+A^£l 

<2£2f A^^ + l + Mj +Af£i, 
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where the last inequality is again due to (4.29), (4.30) and (4.33). Finally, 
by the choice of £1,62, we have that I < e/2. □ 

4.5. Oscillation bound. Consider a cadlag function <^(-) on a fixed interval 
[0,L] taking values in a metric space (E,7r). The modulus of continuity is 
defined to be 

Wi(C(-),5)= sup 7r[C(s),C(t)]. 

s,t€[0,L],\s~t\<5 

If the metric space is M, we just use the Euclidian norm; if the space is M 
or M X M, we use the Prohorov metric d defined in Section 1. We have the 
following bound on the oscillation of the shifted fluid scaled measure- valued 
processes. 



Lemma 4.6. Assume (2.14)~(2.23). Fix T > and L > 1. For each 
e,r] > there exists a 6 > (depending on e and 1]) such that 



(4.34) liminfPM max max(wL(Q''™(-), 5), wl(^'"'"^(-), 5)) < e > 1 - r/. 

r-5.oo \m< [rTJ / 

The proof of this lemma, which builds on the asymptotic regularity in 
Lemma 4.5, uses the exactly same argument as in the proof of Lemma 5.6 
based on Lemma 5.5 in [29]. We omit this proof for brevity. 

Fix T > and L > 0. For any sequence {6i}, consider the following set: 

(4.35) I max max{wL{Q'' {■),dj),WL{Z'- {■),5j)) <-] . 

lm<lrT\ J) 

Denote the sequence {6i} by S. To emphasize the dependency on S and j, 
denote the above event by 0^(5, j). By Lemmas 4.5 and 4.6, for any rj > 0, 
there exists an S such that 

(4.36) liminfP^(n?,(5,j))>l-^ for j = 1, 2, . . . . 
This implies that for any finite number n € N, we have 

limiufPH n J^R(5,j) 1 >l-r//2. 
Let r(n) denote the smallest number such that 

(4.37) ^/?('^' J')^ >l-V for all r > r(n). 
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For any n < n', we have r(n) < r(n') since nj=i 5 0^=1 j)- 

Let 

n(r) = sup{{?i G Z+ : r(n) < r} U {0}}. 

[By this definition, we ahow n(-) to be infinite. For example, when the func- 
tion r(-) has an upper bound. In fact, n(-) can be viewed as the "inverse" 
of r(-).] It is clear that n(-) is nondecreasing. Note that for any no > there 
exists ro = r(no) such that n(r) > no for all r > vq. Thus, we have that 

lim n(r) = oo. 

r— >oo 

Now define 

n(r) 

(4.38) 05^(5) =f| 05^(5, j). 

i=i 

Note that is not empty for all large enough r [since n(r) > 1 for all 

large enough r], and in this case, P'"(r2^(5)) > 1 — ry. So we conclude that 

(4.39) limmfr{nUS)) >l-r). 

r— >oo 

Denote 

(4.40) n'-{M,s) = ni{M)nn'ii{S). 

For any r, the rth system is defined on the probability space (il^',P^', J^*"). 
The stochastic processes Q^(-) and 2^{-) are actually measurable functions 
on i}^ . From now on, we explicitly write these processes down in the form 
of Q^{uj,-) and Z'''{uj,-) to indicate that they are evaluated on the sample 
path oj £ Q^' . We are now ready to present the precompactness result. 

Theorem 4.1. Assume (2.14)-(2.23). Fix T > and L> I. For each 
t] > 0, the exists a constant M > and an S such that such that 

(4.41) liminfP'"(17^(M,cS))>l-r?. 

r— ^-oo 

Suppose {r„}„gN is a sequence in M+ which goes to infinity. Any sequence of 
functions {(Q''"'™" (i:j„, •), (u;„, •))}neN withun e 0''"(M,5) andrrin < 

[r„rj for each ne'N has a subsequence {{Q'^"i'"^''i {cOm, ■) , {ujm, 
such that 

t;l[(Q^"-"'"' (^„^, .),Z^"..-". (o;,^, .)), (Q(.),i(-))] ^0 as i ^ oo, 

for some process {Q{-),Z{-)) which is continuous, where vl is the uniform 
metric defined in (1.1). 
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Proof. For a fixed r/ > 0, pick an Af > that satisfies (4.26) and con- 
struct an S so that it satisfies (4.36). Define Q''(M,5) via (4.40). The prob- 
abihty inequahty (4.41) follows immediately from (4.26) and (4.39). The 
space M X M endowed with the metric d (defined in Section 1.1) is com- 
plete. Lemma 4.4 verifies condition (a) in Theorem 3.6.3 of [11]. For any 
e > there exists a jo such that l/j<e for all j > jq. By (4.35) and (4.38), 
we have that when 6 < 6jg and r > r(jo), where is specified in S and r{n) 
is defined in (4.37), 

(4.42) max(wT(Q'■■'"(a;^•),<5),WT(^^'"(w^•),'^))<e, 

for any uj^' G 0,^{Ad,S) and m < [rT\. This verifies condition (6) in The- 
orem 3.6.3 of [11]. So the sequence {(Q''"''^"(a;'", •),-H'""''""(u;^", •))}n,eN is 
precompact in the space D([0,T],M x M) endowed with the Skorohod Ji 
topology. In other words, there is a convergent subsequence. The limit of this 
subsequence is continuous by the oscillation bound (4.42). So convergence in 
the Skorohod Ji-topology is the same as convergence in the uniform metric 
defined in Section 1.1. □ 

5. State-space collapse. In this section, we establish the state-space col- 
lapse (Theorem 2.2). The task is divided into the following steps: we first 
show that the limits in Theorem 4.1, which called fiuid limits, are fiuid model 
solutions; the set of fluid limits is "rich" in the sense that itself and the set 
of shifted fluid scaled process mutually approximates each other (Lemmas 
5.1 and 5.3); the proof of the state-space collapse result is finally presented 
based on the richness of fiuid limits and the properties of fluid model solution 
(Theorems 3.1 and 3.2). 

5.1. Fluid limits. Let &l{M,S) denote the set of fluid limits of all con- 
vergent subsequences of sequences in Theorem 4.1. It is then quite clear that 
we have the following property. 

Lemma 5.1. Assume (2.14)-(2.23). The set of fluid limits ^l{M,S) 
is nonempty. Pick an element {Q{-),Z{-)) G ^i(M,5), for any e > and 
ro G M+, there exists an r > tq, m < [rTj and co G 0,'''{M,S) such that 

Roughly speaking, this lemma says that any element in &l{M,S) can be 
approximated by a shifted fluid scaled process of the rth system evaluated 
at some sample path in Q^(M,S) with arbitrarily large index r. This helps 
prove the following property of the fluid limits. 

Fix a constant < q <p, where p is the same one as in (2.17) and (2.21). 
Recall the subset of all valid initial conditions deflned in (3.21). 
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Lemma 5.2. Assume (2.14)-(2.23). Fix L>0 and <q <p. Any ele- 
ment {Q(-),Z{-)) G ^l{M,S) is a critically loaded fluid model solution with 
initial condition belongs to 'J^-^j^^j- 

Proof. We first show that the initial condition (Q(0), J(0)) G -J^-^m- % 
the definition of the fluid limit, there exists a subsequence 

(Q'--'"' (wi, 0), J'^-™' (ui, 0)) ^ (Q(0), ^(0)) as f ^ oo, 

where the above convergence is in the Prohorov metric. By Proposition 4.1 
and the LPS policy, we have 

(1, 0) + 0)) < M + + 1, 

ix'+P, gn/m. (^^, 0), (a;,, 0)) < M, 

for all large rj. This implies that for any < q <p, 

<2M + K + 1. 

By the corollary of Theorem 25.12 in [3], we have that for any < q <p, 

(x'+^ gn--. (^.,0) + Z^"^' {u,, 0)) ^ Q(0) + i(0)) as i ^ oo. 

Since we can take M big enough such that M > K + 1, this implies that 
(X^"^^ 2(0) + ^(0)) < 3M and {x, Q(0) + ^(0)) < 3M, which yields the re- 
sult. 

By Lemma 5.1, any fluid limit {Q{-),Z(-)) can be approximated by a 
shifted fluid scaled process of the rth system evaluated at some sample 
path in 0,^{A-'I,S) with arbitrarily large index r £ M+; the state descriptor 
of the rth system satisfies the stochastic dynamic equations (2.5) and (2.6). 
It then follows from the same argument as in Lemmas 6.1 and 6.2 in [29] 
that each fluid limit satisfies the fiuid model equations (3.12) and (3.13) and 
constraints (3.14)-(3.16). In fact, [29] is more general in the sense that the 
traffic intensity is allowed to be any positive number instead of being 1 as 
required in this paper. □ 

5.2. Uniform approximation. Lemma 5.3 in the following is analogous 
to Lemma 4.1 in [6]. In contrast to Lemma 5.1 above, this lemma says that 
any shifted fluid scaled process of the rth system evaluated at some sample 
path in Q^{M,S) with index r large enough can be approximated by some 
element in &l{M,S), which has been proved to be a fluid model solution 
in Lemma 5.2. This result will help prove the state-space collapse result for 
diffusion scaled processes. 
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Lemma 5.3. Assume (2.14)-(2.23). For each e > 0, there exists an tq G 
M+ such that for any r > tq, m < [rTj and uj € Q'''{M,S), we can find a 
{Q{-),Z{-)) e &l{M,S) satisfying 

t;i[(Q^'™(^,.),^^'"^(a;,-)),(Q(-),^(-))]<e- 

Proof. Assume it is not true. Then there exists an e > such that for 
any natural number i there exist an ri > i, rui £ [rTj and G Q^{M,S) 
such that 

for aU {Q{-),Z{-)) G ^i(M,5). However, by Theorem 4.1, the sequence 

{(Q'->'™»(a;„-),^^-'"'(a;„-))}£o 

contains a convergent subsequence, the hmit of which must be in &i{M,S). 
This is a contradiction. □ 

5.3. Proof of state-space collapse. With ah the preparation, we finally 
present the proof of state-space collapse. 

Proof of Theorem 2.2. By (4.41), it suffices to show that for each 
e > 0, there exists an ro such that when r > tq, 

(5.1) sup snv d[{Q'{oj,t),Z''{uj,t)),^K,xW'\uj,t)]<e. 

u}en^{M,s)tGlo,T] 

In the following, we fix r > tq and u G il.^'{M,S). By Lemma 5.2, any (Q(-), 
Z{-)) G &l{M,S) is a critically loaded fluid model solution with initial con- 
dition (^,/i) G =^3^- Denote 

It follows from the workload conservation property (3.20) that W{-) = (Xi C + A*)- 
By Theorem 3.1, there exists an L* > such that when s > L* , 

(5.2) d[{Q{s),Z{s)),AK,,W{s)] < e/3, 

for ah (Q(-),i(-)) G ^l(M,5). Now, fix a constant L> L* + 1. Note that 

LrTJ 

[0,r^T]c [0,rL*]U [j [r{m + L*),r{m + L)]. 

m=0 

By the definition of diffusion and shifted fluid scaling, to show (5.1) it suffices 
to show 

(5.3) max sup d[(Q^'™(w, s), Z^''"(w, s)), aVF''™(w, s)] < e, 

(5.4) sup d[{Q^'^{co,s),Z''''{u,s)),AK,xW'''{u,s)]<e. 

s6[0,L*] 
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We first prove (5.3). Fix an m < \_rT\. By Lemma 5.3, for any e' > 0, 
there exists a (Q(-),Z(-)) G ^l{AI,S) (depending on r,m and a;) such that 



(5.5) 



By the definition of Q''{M,S) and Proposition 4.1, following the same proof 
as in Lemma 5.2, we have that for each fixed <q <p, 

(x'+^Q(t) + ^(t))<3M, 

Q'^.-(^,t) + J-.™(^,t))<3M, 

for all t £ [0,L]. It then follows from Lemma C.2 and by taking e' small 
enough that 

e 



(5.6) 



sup \W{t)-W''"\u,t)\<— 
te[o,L] 3max(l//?,l//?e 



Note that for any real numbers wi,W2, by the definition of the lifting map 
Ak u and the metric d, we have 



d[AK,uWl,AK,u'W2] 

< max ( d 



/3 



Wi A KPe W2 A KPf, 

Ve.. ^ Vp 



/5e 



/3e 



It is clear that for any a,6 > and Borel set ACM, we have that avi^A) < 
bi'{A) + \b — a\ < 6i/(AI''~"I) + |6 — a|, where A^^'"-^ is the \b — a | -enlargement 
of A. Similarly, we have bi^{A) < bi^{A\^~"-^) + \b- a\. So d[au,bi^] <\b- a\. 
This implies that 



d 



< 



{Wi - K/3e)+ {W2 - i^/3e) + 



/3 



/3 



1 



< -\wi - W2\ 



Following the same argument, we have 

Wi A Kpe W2 A KPe 



Wi A KPe W2 A KPe 

Thus, we conclude that 



< 



/3e 



/3e 



< -3-kl - W2\. 



(5.7) d[A/^^j,t(;i, Ai^^,^i(;2] < max 

So (5.3) follows from (5.2) and (5.5)-(5.7). 



1 1 



\Wi — W2\ 
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It now remains to show (5.4). By Lemma 5.3, for any e' > 0, there exists 
a {Q{-),Z{-)) G S>l{M,S) (depending on r and uj) such that 

(5.8) VLm'\uj, ■),Z^'\co, •)), m),Zm < e'. 

By conditions (2.20) and (2.24), we have that 

{Q{0),Z{0)) = Ak,uW{0). 

In other words, the initial condition {Q{0),Z{0)) is an equilibrium state. 
Since {Q{-),Z{-)) is a fluid model solution, by Theorem 3.2, 

{Q{t),Z{t)) = AK,uW{t) foralH>0. 

So (5.4) follows immediately from (5.6)-(5.8) and the above equation. □ 



APPENDIX A: AN INTEGRATION BY PARTS FORMULA FOR 

LEBESGUE-STIELTJES INTEGRAL 

The following lemma is used in the derivation of (3.25) and in the proof 
of Lemma 3.3. We do not require the continuity of distribution function F. 

Lemma A.l. Suppose that F is a probability distribution function with 
F{0)=0, and (7 € D([0, oo), M) has bounded variation on [0,b] for eachb>0. 
For any u> 0, 



[1 - F{u - v)] dq{v) = q{u) - [1 - F{u)]q{0) - q{u - v) dF{v). 
[0,«] i[0,«] 

Proof. Let n > be fixed and let / = [0,u]. Define f{v) = 1 — F{u — v). 
Then / is a left continuous function in on {—oo,u\. Clearly, both / and q 
are functions with bounded variation on the interval I. Let S denote the set 
of points in / where both / and q are discontinuous. According to Theorem 
6.2.2 in [7], 

/ fdq+ [ qdf = f{u+)q{u+)-f{0~)qiO-)+y2A{a) 



(A.l) 



where 



.q^u)-[l-FiuMO)+Y,Aia), 



A{a) = [/(a) - !(/(«+) + /(«"))]((?(«+) - q{a-)) 

+ [g(a) - i(g(a+) + q{a~mf{a+) - f{a-)). 
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Since / is continuous on the left and q is continuous on the right at all a G 5, 
then 

A{a) = [-\{f{a+)-f{a))Ma)-q{a-)] 
(A.2) +[i(g(a)_g(a-))][/(a+)-/(a)] 
= 0. 

Now the lemma follows from (A.l), (A.2) and 



□ 



df= / q{v)dF{u-v)= / q{u-v)dF{v). 



APPENDIX B: A KEY RENEWAL THEOREM WITH UNIFORM 

CONVERGENCE 

The following result is similar as the key renewal theorem. But the con- 
vergence is shown to be uniform on a set of functions as specified below. 



Lemma B.l. Assume that each h G is nonnegative and nonincreas- 
ing. Assume that 

(B.l) Ml = sup /i(0) < oo, 

;>oo 

(B.2) lim sup / h{y)dy = 0. 

he.iT Jx 

Let U be the renewal function associated with a nonlattice inter-renewal 
distribution with finite mean /3. Then 



(B.3) lim sup 



oo 



U * h{x) - ^ / h{y)dy 
P Jo 



0. 



Proof. Conditions (B.l) and (B.2) imply that 

POO 

M2 = sup / h{y) dy < 00. 



Let 5 > and e > be arbitrary positive numbers in (0, 1). By (B.2), there 
exists = N{6, e) such that for each h G 

h{y) dy < Se. 

NS 
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Furthermore, by the Blackwell theorem, there exists x* such that for each 
x>x* and each k = 0, . . . ,N , 

A A 

--6e<U{x-{k + 1)6) - U{x -k6)<- + 5e. 

Let dk{x) = U{x — k5) — U{x — {k + 1)6) for all k >0. Here, we take the 
convention that U{x) = for all a; < 0. Define 

oo 

^^(a;) = X]^(^'^)^{fc^<^•<(fc+l)^}• 
Clearly, h{x) < h^{x) for x > 0. So for x> x* and h E J^, we have 

oo 

U*h{x) <U *h\x) = ^h{k6)dk{t) 

N oo 

= ^/i(M)4(t)+ Yl Kk5)dk{t) 

k=0 k=N+l 
N 



<^hik6)(^+E6)+Ui6) f; h{k6) 

k=0 ^ k=N+l 

< (^6h{0) + h{y) dy^ + ^) + ^(^)\ 12 ^^y^ 

< (^5/1(0) + 12 h{y) dy^ + ^) + ^^(1)^ 

<^j2 ^(y) + + ^) + ^^'^ + 

Define 

oo 

= h{{k + i)6)i{ks<t<ik+m- 

k=0 

Clearly, h{x) > hf{x) for x > 0. So for x > x* and h £ J^, we have 

oo 

U * h{x) >U* h^x) = Y K{k + l)<5)4(i) 

A;=0 

N oo 

= Yh{{k + l)6)dk{t)+ J2 H{k + mdk{t) 

k=0 k=N+l 
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Thus, 



oo oo N 

^h{k6) -6h{0) - ^^^^) 



> 



> 



k=0 

oo 



k=N+2 



e5 



h{y) dy 







{N+1)S 



h{y) dy 



6h{0) 



e6 



1 /■°° 

limsup sup U * h{x) — - / h{y)dy 

x-5>oo h^.j^ P Jo 



< (5Afi ( i + e ) + 2M2e + U{l)e + 



1 



Because 5 > and e > can be arbitrarily small, we have 



lim sup 



U * h{x) - - I h{y)dy 



0. 



□ 



APPENDIX C: SOME RESULTS ON THE PROHOROV METRIC 

Lemma C.l is applied in Section 3.3, and Lemma C.2 is applied in Section 
5.3. Since we could not find these results in the literature, we include them 
here for completeness. 

Lemma C.l. Let /x and jii he finite Borel measures on [0, oo). Denote 
Ay = {y,oo) for all y > 0. Let M = max((x,/i), (x,/Ui))- For all <£ <1 if 

(C.l) sup\n{Ay)- fii{Ay)\<e, 

y>o 

then 

d[^,^i]<(M + 2)ei/3. 

Proof. Let a, /3 be positive constants to be determined later. Note that 

/i((e-",oo)) <Me". 
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For any real number a, denote la = {a,a + e^]. Condition (C.l) implies that 

sup|;u(/a) - Ail (/a) I < 2e. 

aeK 

For any Borel set A C [0,oo), there exist ai,. . . ,a]\f such that 

N 

^n[o,e-"]c|J^,, 

i=l 

and Iq. n laj = for all i ^ j, and la^ D A ^ for all i. These conditions 
imply that 

N < e""-^ 

and 

\Jla.CA^\ 

1=1 

where A^'^ is the e'^-enlargement of the set defined in Section 1.1. So we have 
n{A) < n{A n [0, + i^iA n (£-", oo)) 



</Ui(^U4,^ +N2e + Me^ 



Now choose a = /3 = l/3 to obtain 

fiiA) < (^(*^+2)-^/' ) + (M + 2)ei/3 . 
Exchanging the position of /U and fii in the above argument, we have 

W (A) < f,{A^^'+^>'^' ) + (M + 2)ei/3 . 
This completes the proof. □ 

Lemma C.2. Suppose fii and fi are finite Borel measures on M+ satis- 
fying 

(C.2) d[fii,fi]<e<l, 

and {x^^'',lJ-i) < M, {x^^'^,lj) < M for some positive constants q and M, 
then 

\{x,^^l)-{x,^^)\<e'/' + —e''/'. 
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Proof. By Markov inequality, Hi{Ax) < and fi{Ax) < jtt? for all 
x>0. For any C > 0, we have the following inequality: 

\{x,f^i) - {x,fJ')\ < [ IfJ'iiA^) - fJ'{A^)\dx 
Jo 



+ / iJ.i{Ax)dx+ / ij,{Ax)dx 
Jc Jc 



<Ce + 2 / —— dx 
Jc 

= Ce + 2M- ^ 



qCl 

The result follows by letting C = e~^/^. □ 

APPENDIX D: GLIVENKO-CANTELLI ESTIMATE 

For any r, consider the sequence of i.i.d. random variables {vl}'^_^ with 
law . In our setting, those v^'s with i > 1 correspond to the service re- 
quirement of the arriving jobs in the rth system; those with i < correspond 
to the service requirement of initial jobs waiting in the buffer. For any n G Z 
and / G 1R+ , define 

n+[rl\ 

(D.l) f{n,l) = - E 

i=n+l 

The objective of this section is to obtain the Glivenko-Cantelli estimate, 
Lemma D.l below, for ff{n,l). Very similar result was shown in Lemma 4.7 
[13]. For completeness, the proof which follows the one in [13] is provided 
here. 

To present the result, we introduce some notions from empirical process 
theory. Our primary references are [13] and [25]. 

A collection C of subsets of shatters an n-point subset {xi, . . . C 
IR4. if the collection {C H {xi, . . . , Xn} : C G C} has cardinality 2". In this case, 
we say that C picks out all subsets of {xi, . . . The Vapnik-Cervonenkis 
index ( VC-index) of C is 

Vc =min{n:C shatters no n-point subset}, 

where the minimum of the empty set equals infinity. The collection C is a 
Vapnik-Cervonenkis class ( VC-class) if it has finite VC-index. Let be a 
family of Borel measurable functions / : iZ+ — t- M. We call ^ a VC-class if 
the collection of subgraphs {{{x, y):y< f{x)} : f G is a VC-class of sets 
in R^. 
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We call a family of functions 'Y a Borel measurable class if, for each n G N 
and (ei, . . . , e„) E { — 1, 1}", the map 

n 

(xi,...,x„)-^ supy^Ci f{Xi) 



is Borel measurable on M" . The condition requires that, for all 5 > and 

G 

9)'^ '■ 1^9 ^ ^} Borel measurable, where 



r G M+, the families = {/ - 5 : /,5 G ^, 11/ - 5||.^2 < <5} and = {(/ 



denotes the L2(i''')-norm. 

We call a Borel measurable function / : — t- M an envelope function 
for Y if any element in 'Y is bounded by /. A VC-class with an envelop 
function satisfies a very useful entropy bound. Let T be the set of finitely 
discrete probability measures 7 on R+ such that ||/||7,2 > 0. For any Borel 
measurable function /:M+ — )• M satisfying ||/||'y,2 < 00, let Bf{e) = {5 G 
lb ~ /III''', 2 < e} denote the L2(i^'')-ball in Y , centered at / with ra- 
dius £. For a family of functions Y, N [e , L2{'^)) is the smallest number 
of balls Bf{£) needed to cover Then satisfies 

(D.2) r sup JlogN{e\\f\\^,2, r, ^2(7)) de < 00; 

Jo 7Gr ^ 

see Definition 2.1.5, (2.5.1) and Theorem 2.6.7 in [25]. 

Lemma D.l. Let Y he a VC-class of Borel measurable functions such 
that -f^ and are Borel measurable classes for all r G and 5 > 0. 
Assume there exists an envelop function f of 'f such that 

(D.3) hm sup(/"^l;>^,z.O=0. 

Fix constants Mi,Li > 0. For all £,e' > 0, 

limsupF*"! max sup sup\{f,fj'^{n,l)) — l{f,i''^\Ax))\>e' 

'I — >oo \—rMi<n<r^ Ml ;g[Q ^^^j f^y 

(D.4) 

< e. 

Remark D.l. To apply the lemma in this paper, we take 
(D.5) r = {lc:CGC}U{x^+^x'+^}, 

where C = { [y , 00) : y G M+} U { (y , 00) : y G M+} and p is the same one as in 
condition (2.17). It is very easy to see that 1^ is a VC-class. Note that both 
'fg' and are subsets of functions of the form l(a,b) (or l(a,6]) l[a,6); ^[a,b])- 
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So the supreme over these two famihes wih be the same as supreme over all 
a, b in subsets of M+, which will be the same as over all a, b in subsets of Q. 
Borel measurability is preserved when take supreme over a countable set. It 
is also clear that 

fix) = I l^l'^ 

is an envelop function. Condition (2.17) implies (D.3). 



To better structure the proof, we present the following auxiliary lemma. 



Lemma D.2. For n£Z and A; G N, define 

^ n+k 
i=n+l 

Then for any q > 1, y > 2 and n € Z there exists Mq < oo and ko such that 
k> kQ implies 

(D.7) supF^(sup(/,C,,)>y)<^. 
The constant Mq does not depend on y. 



Proof. Let us first fix n = and look at which will be denoted 
by for simplicity. The property (D.3) of the envelop function / and the 
uniform entropy bound (D.2), together with the sets and being 
Borel measurable, imply that Y is Donsker and pre-Gaussian uniformly in 
z^^, r G M+. (See Theorem 2.8.3 in [25].) 

Let l°^{y) be the space of all probability measures on R_|_ equipped with 
norm || • || = supjgy (/, ■). Y being Donsker uniformly in z/'' means that 
converges weakly as n — )• oo in to a tight, Borel measurable version 

of the Brownian bridge uniformly for all i^'^ . According to Chapter 1.12 
in [25], this is equivalent to 

(D.8) sup \E''h{Ck) - ^h{C)\ 0. 

/iGBLi 

uniformly for all i'^ , where BLi is the set of functions h:l°°(Y) — )■ R which 
are uniformly bounded by 1 and satisfy \h{zi) — h{z2)\ < [[^^i — ^2!! Pre- 
Gaussian uniformly in v'' means that 



(D.9) supE^ sup{f,C 



< 00. 
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Define /ly : ^ M by 

hyi-) = (snp{f,-)-y + lY Al. 

Then it is clear that G BLi, and 



supr' sup(/,e[:) >y\< supEl/i,,(eD]. 

By (D.8) and the above inequahty, there exists ko £ N such that k > ko 
implies 



supP^ sup(/,eD >y)< snpE-[hy{e)] + y-''- 

Applying the definition of hy and Markov inequality to obtain 
supP^f sup(/,Q > y) < supP^(sup(/,e) >y-l)+y 



+ 1 . 



fey ' r Ve; 

<y-''(2«supE'-[sup(/,r 

Let Mq be the last term in parentheses, which does not depend on y. For each 
r G R+, the Brownian bridge is separable and Gaussian with supj^y{f,S^'^) 
finite almost surely. Thus, there exist a constant M such that for all r £ M+, 



sup(/,r 



<M 



see Proposition A. 2. 4 in [25]. Conclude from (D.9) that Mq < oo. 

So far, we have shown that the result (D.7) is true for n = 0. Note that 

for any n G Z, ^ is defined on the shifted sequence t'J^_|_2, By the 

i.i.d. property of the sequence, if we fix k then ^ has the same distribution 
for all n£7L. So we can conclude that (D.7) is true for all n£TL. □ 



Proof of Lemma D.l. Note that 



n+ \rl\ 



i=n+l 



Since for each e' > 0, 1/r < e'/2 for all large r, so the probability in (D.4) 
can be bounded by 



(D.IO) limsupl 



max sup sup 



- E [(/,%>- a -0] > 2 [ 

i=n+l / 
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Pick 6 > 0, when r is large enough (r > Mi/ 6) the interval [— rMi,r^Mi] 
will be covered by intervals 



[( 


"Ml" 




"Ml" 






5 


5 





[-r^6,0],[0,rH],..., 
When r is large enough (r^5 > [rLiJ), (D.IO) can be further bounded by 



limsupl 

r— >oo 



max max sup 

'l<j<\Mi/5']~10<k,k'<r^5 f<zy 



-(/.?; 



-{f,e 



'jr'^5,k' 



> 



Since has stationary increments, the previous term can be bounded above 
by 



limsup 

r—^oo 



Ml 



max sup 



{f^Co,k) 



> 



By Ottaviani's inequality (see Proposition A. 1.1 in [25]) and by stationary 
increments of . , this can be bounded above by 



(D.ll) limsup 



rMi/^lP-'(sup;sy(/,^S^^,3^j) > e'/{4Vd)) 
1 - maxo<fc<,.25P'^(supjg ^.(/,C5_^) > e'r/{4y/k)) 



Assume 5 is small enough so that -^-^ > 2. By Lemma D.2, there exists M3 
and ko such that k> implies 



supp^(sup(/,es,fc) 



> 



171) - {^'J 



Ms. 



Since [r^(5J — )■ 00 as r — )■ 00, the limit superior of the numerator in (D.ll) can 
be bounded above by \Mi/6~\{4^/6/e')^M3, which can be made arbitrarily 
small by choosing 5 sufficiently small. By the same reason, those terms in 
the maximum of the denominator with index k > ko are bounded above by 
{4:\/6/e')^M3. For those terms with index k < ko, 



e'r 



V/er 4VA; 



< 



e'r 



SUp(/,Co',fc) > , rr 

/er 4Vfco 



which converges to zero as r — t- 00. By choosing 5 small enough, (D.ll) can 
be made arbitrarily small for all large r. □ 
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